00010000:00010000:1.0F:1788863908.139655:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863908.331860:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226644992:0@lo:400:kworker.0 00000100:00100000:1.0:1788863908.331941:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1788863908.332322:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226645376:0@lo:400:kworker.0 00000100:00100000:0.0:1788863908.332365:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863908.332408:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226644992 00000100:00100000:0.0:1788863908.332415:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226644992 00000100:00100000:0.0:1788863908.332455:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788863908.332463:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3643:x1875759226644992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863908.335238:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226645504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863908.335947:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1788863908.337449:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226645120:0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.337528:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863908.337574:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226645632:0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.337601:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863908.337618:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226646144:0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.337638:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863908.337663:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788863908.337669:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226645248:0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.337691:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863908.337723:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226645760:0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.337743:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863908.337760:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226646272:0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.337780:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863908.337826:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226645120 00000100:00100000:3.0:1788863908.337834:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226645120 00000100:00100000:3.0:1788863908.337876:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226645760 00000100:00100000:3.0:1788863908.337879:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226645760 00000100:00100000:3.0:1788863908.337896:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788863908.337904:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226645120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.337956:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226645120:12345-0@lo:400:kworker.0 Request processed in 52us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863908.337962:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788863908.337979:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788863908.337985:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226645760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.338010:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226645760:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863908.338016:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788863908.338043:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226645632 00000100:00100000:3.0:1788863908.338046:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226645632 00000100:00100000:3.0:1788863908.338069:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226646144 00000100:00100000:3.0:1788863908.338104:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226646144 00000100:00100000:3.0:1788863908.338134:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226646272 00000100:00100000:3.0:1788863908.338137:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226646272 00000100:00100000:3.0:1788863908.338548:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788863908.338556:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226645632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.338593:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226645632:12345-0@lo:400:kworker.0 Request processed in 39us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863908.338599:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788863908.338615:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788863908.338621:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226646144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.338646:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226646144:12345-0@lo:400:kworker.0 Request processed in 26us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863908.338652:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788863908.338663:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788863908.338668:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226646272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.338692:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226646272:12345-0@lo:400:kworker.0 Request processed in 23us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863908.338711:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788863908.338734:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226645376 00000100:00100000:3.0:1788863908.338738:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226645376 00000100:00100000:3.0:1788863908.338764:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226645248 00000100:00100000:3.0:1788863908.338767:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226645248 00000100:00100000:3.0:1788863908.338789:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788863908.338796:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226645376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.338826:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226645376:12345-0@lo:400:kworker.0 Request processed in 31us (6461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863908.338840:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788863908.338852:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788863908.338857:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226645248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.338883:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226645248:12345-0@lo:400:kworker.0 Request processed in 26us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863908.338889:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788863908.338912:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863908.338916:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788863908.338919:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863908.338921:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788863908.338954:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1788863908.338959:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e543440a80, transno 8589934596 00000004:00080000:3.0:1788863908.339369:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788863908.339394:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226645248:0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.339411:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226645760:0@lo:400:kworker.0 00010000:00080000:3.0:1788863908.339422:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681cabb80 x1875759226646272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863908.339435:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226646272:0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.339444:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226645120:0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.339454:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226645632:0@lo:400:kworker.0 00000100:00100000:3.0:1788863908.339463:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226646144:0@lo:400:kworker.0 00000100:00100000:0.0:1788863908.347737:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3643:x1875759226644992:12345-0@lo:400:kworker.0 Request processed in 15262us (15785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863908.347751:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788863908.347835:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226645888:0@lo:400:kworker.0 00000100:00100000:0.0:1788863908.347889:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863908.347928:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226646400:0@lo:400:kworker.0 00000100:00100000:0.0:1788863908.347954:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863908.347994:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226645376:0@lo:400:kworker.0 00000100:00100000:0.0:1788863908.348016:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788863908.348023:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226646016:0@lo:400:kworker.0 00000100:00100000:0.0:1788863908.348044:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863908.348061:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226646528:0@lo:400:kworker.0 00000100:00100000:2.0F:1788863908.348357:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226646656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863908.363164:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863908.363250:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226645504 00000100:00100000:2.0:1788863908.363260:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226645504 00000100:00100000:2.0:1788863908.363321:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226646656 00000100:00100000:2.0:1788863908.363324:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226646656 00000100:00100000:2.0:1788863908.363339:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788863908.363348:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226645504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863908.363379:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788863908.363419:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226645504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (27474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863908.363425:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788863908.363440:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788863908.363445:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226646656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863908.363454:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788863908.363494:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226646656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863908.363500:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788863908.363515:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863908.363560:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226646656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788863908.363615:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226646400 00000100:00100000:2.0:1788863908.363619:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226646400 00000100:00100000:2.0:1788863908.363645:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226646016 00000100:00100000:2.0:1788863908.363648:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226646016 00000100:00100000:2.0:1788863908.363661:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788863908.363667:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226646400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863908.363713:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226646400:12345-0@lo:400:kworker.0 Request processed in 47us (15758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863908.363735:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788863908.363747:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788863908.363753:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226646016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863908.363785:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226646016:12345-0@lo:400:kworker.0 Request processed in 32us (15740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863908.363791:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788863908.363815:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226645888 00000100:00100000:2.0:1788863908.363818:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226645888 00000100:00100000:2.0:1788863908.363849:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788863908.363855:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226645888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863908.363885:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226645888:12345-0@lo:400:kworker.0 Request processed in 30us (15995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863908.363890:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788863908.363906:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863908.363909:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863908.364300:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863908.364337:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226645888:0@lo:400:kworker.0 00000100:00100000:0.0:1788863908.364349:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226646400:0@lo:400:kworker.0 00000100:00100000:0.0:1788863908.364369:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226646016:0@lo:400:kworker.0 00000100:00100000:0.0:1788863908.364398:0:20258:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226646528 00000100:00100000:0.0:1788863908.364401:0:20258:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226646528 00000100:00100000:0.0:1788863908.364436:0:20258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788863908.364451:0:20258:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226646528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863908.364490:0:20258:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226646528:12345-0@lo:400:kworker.0 Request processed in 40us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863908.364496:0:20258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788863908.364510:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788863908.364526:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e681ca9180 x1875759226646528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863908.364548:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226646528:0@lo:400:kworker.0 00000100:00100000:1.0:1788863908.370835:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226644992:0@lo:400:kworker.0 00000100:00100000:1.0:1788863908.370897:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226645504:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1788863908.848735:0:17040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000020:00080000:2.0:1788863908.848763:0:17040:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e6808ef600 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:2.0:1788863908.848769:0:17040:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e6504d0c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e6808efe40 00000020:00080000:2.0:1788863908.848773:0:17040:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff89e6504d0900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e542b03200 00000020:00080000:2.0:1788863908.848803:0:17100:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:2.0:1788863908.848875:0:17100:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788863908.848947:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a698 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.848960:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a698 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.848968:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a698 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.848975:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788863908.848980:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a698 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.848989:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a698 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.849005:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e65d52e800) 00010000:00010000:1.0:1788863908.849008:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788863908.849013:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a698 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863908.849020:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922200/0xf569beb9d4b6a698 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788863908.850578:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863908.854671:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226646784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788863908.854759:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863908.855515:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226646784 00000100:00100000:2.0:1788863908.855534:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226646784 00000100:00100000:2.0:1788863908.855600:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788863908.855609:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226646784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788863908.855649:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788863908.855701:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226646784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863908.855708:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788863908.856430:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226646784:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788863909.163758:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788863909.615392:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788863909.867276:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863909.867311:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226646912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863909.867407:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863909.868108:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226646912 00000100:00100000:2.0:1788863909.868124:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226646912 00000100:00100000:2.0:1788863909.868196:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788863909.868211:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226646912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788863909.868244:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788863909.868309:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226646912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863909.868317:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788863909.868840:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226647040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863909.868891:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863909.868976:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226646912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788863909.870720:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226647168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863909.870795:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863909.870859:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226647040 00000100:00100000:1.0:1788863909.870868:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226647040 00000100:00100000:1.0:1788863909.870916:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226647168 00000100:00100000:1.0:1788863909.870919:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226647168 00000100:00100000:1.0:1788863909.870941:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788863909.870950:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226647040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788863909.870998:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788863909.871051:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226647040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863909.871059:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788863909.871103:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788863909.871110:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226647168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788863909.871134:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788863909.871170:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226647168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863909.871177:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788863909.871249:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226647168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863909.871314:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226647040:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788863910.187353:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863911.218712:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863911.910504:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863911.910703:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205597312 00000100:00100000:1.0:1788863911.910732:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205597312 00000100:00100000:1.0:1788863911.910833:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 74 00000100:00100000:1.0:1788863911.910847:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+12:15558:x1875759205597312:12345-192.168.204.35@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788863911.910958:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2472872-203b-4543-b84a-9e24d2c107a6+12:15558:x1875759205597312:12345-192.168.204.35@tcp:60:lhsmtool_posix.0 Request processed in 115us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863911.910965:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 74 00000100:00080000:2.0:1788863911.911514:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788863911.919423:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863911.919561:0:20258:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205597440 00000100:00100000:1.0:1788863911.919577:0:20258:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205597440 00000100:00100000:1.0:1788863911.919663:0:20258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 75 00000100:00100000:1.0:1788863911.919676:0:20258:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2472872-203b-4543-b84a-9e24d2c107a6+5:15558:x1875759205597440:12345-192.168.204.35@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788863911.919812:0:20258:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2472872-203b-4543-b84a-9e24d2c107a6+5:15558:x1875759205597440:12345-192.168.204.35@tcp:60:lhsmtool_posix.0 Request processed in 139us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863911.919820:0:20258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 75 00000100:00080000:0.0:1788863911.923681:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863911.945127:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863911.945455:0:17063:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205597696 00000100:00100000:0.0:1788863911.945479:0:17063:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205597696 00000100:00100000:0.0:1788863911.945551:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:0.0:1788863911.945563:0:17063:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f816450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+12:15558:x1875759205597696:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788863911.945913:0:17063:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f816450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2472872-203b-4543-b84a-9e24d2c107a6+13:15558:x1875759205597696:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 351us (838us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1788863911.945921:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00010000:00010000:1.0:1788863912.236854:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863912.435979:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863912.436127:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863912.436164:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863912.436206:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863912.436247:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205598080 00000100:00100000:1.0:1788863912.436277:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205598080 00000100:00100000:3.0:1788863912.437111:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205597952 00000100:00100000:3.0:1788863912.437120:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205597952 00000100:00100000:3.0:1788863912.437220:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 37 00000100:00100000:3.0:1788863912.437232:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2472872-203b-4543-b84a-9e24d2c107a6+6:2409:x1875759205597952:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863912.437759:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2472872-203b-4543-b84a-9e24d2c107a6+6:2409:x1875759205597952:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 526us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863912.437768:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 37 00000100:00080000:3.0:1788863912.437805:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863912.439028:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205598208 00000100:00100000:2.0:1788863912.439046:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205598208 00000100:00100000:2.0:1788863912.439159:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 90 00000100:00100000:2.0:1788863912.439169:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2409:x1875759205598208:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863912.439300:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2409:x1875759205598208:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 130us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863912.439308:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 90 00000100:00100000:1.0:1788863912.440009:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 91 00000100:00100000:1.0:1788863912.440039:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2409:x1875759205598080:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863912.440117:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2409:x1875759205598080:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 80us (3989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863912.440125:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 91 00000100:00080000:3.0:1788863912.440834:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863912.440843:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788863912.446688:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205597824 00000100:00100000:0.0:1788863912.446712:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205597824 00000100:00100000:0.0:1788863912.447925:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 173 00000100:00100000:0.0:1788863912.447948:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:2409:x1875759205597824:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863912.448089:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:2409:x1875759205597824:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 136us (12108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863912.448100:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 173 00000001:00100000:2.0:1788863912.941972:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d 00000020:00000080:2.0:1788863912.941983:0:19382:0:(genops.c:885:class_export_put()) final put ffff89e543ac6000/83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d 00000001:00100000:2.0:1788863912.942003:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f2472872-203b-4543-b84a-9e24d2c107a6 00000020:00000080:2.0:1788863912.942005:0:19382:0:(genops.c:885:class_export_put()) final put ffff89e67d2b7000/f2472872-203b-4543-b84a-9e24d2c107a6 00000020:00000080:3.0:1788863912.942265:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543ac6000/83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d for lustre-OST0001 00000020:00000080:3.0:1788863912.942847:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67d2b7000/f2472872-203b-4543-b84a-9e24d2c107a6 for lustre-OST0001 00000020:00000080:3.0:1788863912.942871:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e543ac5800 for lustre-OST0001 00000020:00000080:3.0:1788863912.942877:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67d2b6000 for lustre-OST0001 00000001:00100000:0.0:1788863912.944808:0:18564:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d 00000020:00000080:0.0:1788863912.944816:0:18564:0:(genops.c:885:class_export_put()) final put ffff89e5425be800/83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d 00000020:00000080:2.0:1788863912.944897:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425be800/83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d for lustre-OST0000 00000020:00000080:2.0:1788863912.944955:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e543ac6800 for lustre-OST0000 00010000:00010000:2.0:1788863913.261884:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863913.451454:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863913.451488:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226647296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863913.451560:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863913.451683:0:19852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226647296 00000100:00100000:2.0:1788863913.451692:0:19852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226647296 00000100:00100000:2.0:1788863913.451755:0:19852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788863913.451766:0:19852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226647296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863913.451794:0:19852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788863913.451840:0:19852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226647296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863913.451847:0:19852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788863913.451919:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863913.451955:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226647296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863913.452697:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226647424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863913.452742:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863913.452851:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226647424 00000100:00100000:2.0:1788863913.452857:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226647424 00000100:00100000:2.0:1788863913.452911:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788863913.452919:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226647424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788863913.452945:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788863913.452980:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226647424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863913.452987:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788863913.453104:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863913.453167:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226647424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863913.454054:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226647808:0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.454117:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863913.454139:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226648320:0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.454163:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863913.454180:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226648832:0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.454199:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863913.454204:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226647808 00000100:00100000:2.0:1788863913.454210:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226647808 00000100:00100000:0.0:1788863913.454225:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788863913.454230:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226647680:0@lo:400:kworker.0 00000100:00100000:2.0:1788863913.454250:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788863913.454253:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863913.454270:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226647808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.454280:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226648192:0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.454299:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863913.454308:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226647808:12345-0@lo:400:kworker.0 Request processed in 50us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863913.454313:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226648704:0@lo:400:kworker.0 00000100:00100000:2.0:1788863913.454314:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788863913.454327:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226648192 00000100:00100000:0.0:1788863913.454330:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863913.454342:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226648192 00000100:00100000:0.0:1788863913.454354:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226647808:0@lo:400:kworker.0 00000100:00100000:2.0:1788863913.454362:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788863913.454368:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226648192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.454375:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226648320 00000100:00100000:0.0:1788863913.454377:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226648320 00000100:00100000:2.0:1788863913.454400:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226648192:12345-0@lo:400:kworker.0 Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863913.454401:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226648832 00000100:00100000:0.0:1788863913.454403:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226648832 00000100:00100000:2.0:1788863913.454406:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788863913.454420:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226648704 00000100:00100000:0.0:1788863913.454423:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226648704 00000100:00100000:2.0:1788863913.454429:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226647936:0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.454449:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788863913.454455:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226648320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863913.454463:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788863913.454517:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863913.454521:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863913.454523:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863913.454634:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226647680 00000100:00100000:3.0:1788863913.454638:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226647680 00000100:00100000:3.0:1788863913.454677:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788863913.454684:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226647680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863913.454730:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226648448:0@lo:400:kworker.0 00000100:00100000:1.0:1788863913.454794:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226647552:0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.461045:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226648320:12345-0@lo:400:kworker.0 Request processed in 4378us (4669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863913.461109:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788863913.461149:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226647936 00000100:00100000:0.0:1788863913.461158:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226647936 00000100:00100000:0.0:1788863913.461191:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788863913.461201:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226648832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.461299:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226648832:12345-0@lo:400:kworker.0 Request processed in 100us (7098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863913.461306:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788863913.461320:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788863913.461327:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226648704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.461357:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226648704:12345-0@lo:400:kworker.0 Request processed in 31us (7025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863913.461363:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788863913.461375:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788863913.461382:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226647936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.461413:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226647936:12345-0@lo:400:kworker.0 Request processed in 32us (6948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863913.461418:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788863913.461496:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226648192:0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.461509:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226648704:0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.461519:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226648320:0@lo:400:kworker.0 00010000:00080000:0.0:1788863913.461532:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67f899c00 x1875759226648832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863913.461542:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226648832:0@lo:400:kworker.0 00000100:00100000:3.0:1788863913.467009:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226647680:12345-0@lo:400:kworker.0 Request processed in 12315us (12744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863913.467024:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788863913.467110:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226647680:0@lo:400:kworker.0 00000100:00100000:2.0:1788863913.468732:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863913.468774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863913.468803:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226648448 00000100:00100000:0.0:1788863913.468812:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226648448 00000100:00100000:2.0:1788863913.468820:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226647936:0@lo:400:kworker.0 00000100:00100000:1.0:1788863913.468836:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226648064:0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.468873:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788863913.468879:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863913.468888:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226648448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863913.468902:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226648576:0@lo:400:kworker.0 00000100:00100000:2.0:1788863913.468905:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226648064 00000100:00100000:2.0:1788863913.468910:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226648064 00000100:00100000:1.0:1788863913.468937:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863913.468954:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788863913.468962:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226648448:12345-0@lo:400:kworker.0 Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863913.468966:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226648064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863913.468977:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788863913.468988:0:20258:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226648576 00000100:00100000:1.0:1788863913.468993:0:20258:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226648576 00000100:00100000:2.0:1788863913.469014:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226648064:12345-0@lo:400:kworker.0 Request processed in 51us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863913.469022:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788863913.469034:0:20258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788863913.469043:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226648064:0@lo:400:kworker.0 00000100:00100000:1.0:1788863913.469045:0:20258:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226648576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863913.469066:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226648448:0@lo:400:kworker.0 00000100:00100000:1.0:1788863913.469112:0:20258:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226648576:12345-0@lo:400:kworker.0 Request processed in 69us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863913.469121:0:20258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1788863913.469137:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67f89a300 x1875759226648576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863913.469148:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226648576:0@lo:400:kworker.0 00000100:00100000:3.0:1788863913.469204:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226647552 00000100:00100000:3.0:1788863913.469209:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226647552 00000100:00100000:3.0:1788863913.469244:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788863913.469251:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3643:x1875759226647552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863913.469293:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3643:x1875759226647552:12345-0@lo:400:kworker.0 Request processed in 43us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863913.469299:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1788863913.469324:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788863913.469327:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863913.469805:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226647552:0@lo:400:kworker.0 00000100:00100000:1.0:1788863913.964319:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863913.964342:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226648960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863913.964410:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863913.964752:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226648960 00000100:00100000:3.0:1788863913.964761:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226648960 00000100:00100000:3.0:1788863913.964813:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788863913.964822:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226648960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863913.964847:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788863913.964889:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226648960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863913.964896:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788863913.965185:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226648960:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788863914.283314:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788863914.487854:0:20438:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 06:38:32 (1788863912) 00000100:00100000:1.0:1788863914.987358:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226649088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863914.987397:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863914.987426:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226649216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863914.987453:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863914.987484:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226649088 00000100:00100000:3.0:1788863914.987587:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226649088 00000100:00100000:3.0:1788863914.987649:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788863914.987658:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226649088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788863914.987696:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788863914.987787:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788863914.987800:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226649344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863914.988043:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226649088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 384us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863914.988051:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788863914.991704:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226649088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863914.991791:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863914.991843:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226649216 00000100:00100000:1.0:1788863914.991851:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226649216 00000100:00100000:1.0:1788863914.992097:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788863914.992110:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226649216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788863914.992144:0:18128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788863914.992206:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226649216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863914.992213:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788863914.992305:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226649216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788863914.992759:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863914.992839:0:19852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226649344 00000100:00100000:1.0:1788863914.992845:0:19852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226649344 00000100:00100000:1.0:1788863914.992949:0:19852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788863914.992958:0:19852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226649344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863914.992989:0:19852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788863914.993523:0:19852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226649344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 566us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863914.993532:0:19852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788863914.993709:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226649344:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788863914.997589:0:17040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:2.0:1788863914.997606:0:17040:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:3.0:1788863914.997670:0:17100:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1788863914.997684:0:17100:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:2.0:1788863915.310804:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863915.896168:0:17098:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788863915.896181:0:17098:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863915.896208:0:17098:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788863915.896215:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788863916.331589:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863917.357978:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863917.550370:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863917.551790:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863917.551881:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863917.551943:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863917.551961:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205598592 00000100:00100000:3.0:1788863917.551993:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863917.551996:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205598592 00000100:00100000:3.0:1788863917.552042:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863917.552104:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205598720 00000100:00100000:3.0:1788863917.552110:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205598720 00000100:00100000:2.0:1788863917.552118:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205598848 00000100:00100000:2.0:1788863917.552124:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205598848 00000100:00100000:2.0:1788863917.552150:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205598464 00000100:00100000:2.0:1788863917.552157:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205598464 00000100:00100000:3.0:1788863917.552161:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 40 00000100:00100000:2.0:1788863917.552179:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205598976 00000100:00100000:3.0:1788863917.552181:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2472872-203b-4543-b84a-9e24d2c107a6+6:2410:x1875759205598720:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863917.552184:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205598976 00000100:00100000:2.0:1788863917.552204:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 98 00000100:00100000:2.0:1788863917.552213:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+5:2410:x1875759205598592:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863917.552290:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+5:2410:x1875759205598592:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 77us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863917.552303:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 98 00000100:00100000:1.0:1788863917.552328:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 99 00000100:00100000:2.0:1788863917.552337:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 100 00000100:00100000:1.0:1788863917.552345:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2410:x1875759205598848:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788863917.552364:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+12:2410:x1875759205598464:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863917.552530:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205598336 00000100:00100000:0.0:1788863917.552537:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205598336 00000100:00100000:0.0:1788863917.552574:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 175 00000100:00100000:0.0:1788863917.552582:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:2410:x1875759205598336:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863917.554630:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2472872-203b-4543-b84a-9e24d2c107a6+6:2410:x1875759205598720:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 2441us (2622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863917.554650:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 40 00000100:00080000:3.0:1788863917.554750:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788863917.554761:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788863917.554765:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788863917.554836:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 101 00000100:00100000:3.0:1788863917.554855:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2410:x1875759205598976:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788863917.554959:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2410:x1875759205598848:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 2617us (3076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863917.554970:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 99 00000100:00100000:2.0:1788863917.555052:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2472872-203b-4543-b84a-9e24d2c107a6+12:2410:x1875759205598464:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 2408us (2812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863917.555064:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 100 00000100:00100000:0.0:1788863917.555249:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:2410:x1875759205598336:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 2665us (4904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863917.555261:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 175 00000100:00100000:3.0:1788863917.556333:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2410:x1875759205598976:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 1483us (4288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863917.556346:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 101 00010000:00010000:3.0:1788863918.381030:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863918.571387:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863918.571420:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e541ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226649472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863918.571518:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863918.571614:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226649472 00000100:00100000:3.0:1788863918.571631:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226649472 00000100:00080000:1.0:1788863918.571680:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788863918.571711:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788863918.571726:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226649472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788863918.571760:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788863918.571855:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226649472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863918.571862:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788863918.572113:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e541ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226649472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863918.572608:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226649856:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.572656:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863918.572691:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226650368:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.572714:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863918.572729:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226650880:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.572751:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863918.572772:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788863918.572778:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226649728:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.572798:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863918.572833:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226650240:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.572853:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863918.572870:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226650752:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.572888:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863918.572915:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226649728 00000100:00100000:1.0:1788863918.572920:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226649728 00000100:00100000:1.0:1788863918.572964:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226650240 00000100:00100000:1.0:1788863918.572968:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226650240 00000100:00100000:1.0:1788863918.572999:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788863918.573005:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226649728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573050:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226649728:12345-0@lo:400:kworker.0 Request processed in 45us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863918.573057:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788863918.573098:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788863918.573106:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226650240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573134:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226650240:12345-0@lo:400:kworker.0 Request processed in 30us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863918.573139:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788863918.573163:0:20258:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226650880 00000100:00100000:1.0:1788863918.573167:0:20258:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226650880 00000100:00100000:1.0:1788863918.573216:0:20258:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226650752 00000100:00100000:1.0:1788863918.573219:0:20258:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226650752 00000100:00100000:1.0:1788863918.573237:0:20258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788863918.573244:0:20258:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226650880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573272:0:20258:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226650880:12345-0@lo:400:kworker.0 Request processed in 29us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863918.573277:0:20258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788863918.573288:0:20258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788863918.573294:0:20258:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226650752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573318:0:20258:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226650752:12345-0@lo:400:kworker.0 Request processed in 25us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863918.573324:0:20258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788863918.573350:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863918.573354:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863918.573385:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226649728:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573402:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226650240:0@lo:400:kworker.0 00010000:00080000:1.0:1788863918.573413:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440d1c00 x1875759226650752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863918.573422:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226650752:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573432:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226650880:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573456:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226649600:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573484:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863918.573510:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226650112:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573530:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863918.573543:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226650624:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573561:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863918.573579:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788863918.573585:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226649984:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573603:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863918.573618:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226650496:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573635:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863918.573644:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226651008:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573659:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863918.573676:0:20258:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226650112 00000100:00100000:1.0:1788863918.573679:0:20258:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226650112 00000100:00100000:1.0:1788863918.573695:0:20258:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226650624 00000100:00100000:1.0:1788863918.573697:0:20258:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226650624 00000100:00100000:1.0:1788863918.573713:0:20258:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226650496 00000100:00100000:1.0:1788863918.573716:0:20258:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226650496 00000100:00100000:1.0:1788863918.573734:0:20258:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226651008 00000100:00100000:1.0:1788863918.573737:0:20258:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226651008 00000100:00100000:1.0:1788863918.573750:0:20258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788863918.573756:0:20258:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226650112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573791:0:20258:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226650112:12345-0@lo:400:kworker.0 Request processed in 35us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863918.573797:0:20258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788863918.573809:0:20258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788863918.573816:0:20258:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226650624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573841:0:20258:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226650624:12345-0@lo:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863918.573846:0:20258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788863918.573857:0:20258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788863918.573863:0:20258:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226650496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573887:0:20258:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226650496:12345-0@lo:400:kworker.0 Request processed in 25us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863918.573893:0:20258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788863918.573903:0:20258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788863918.573909:0:20258:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226651008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.573943:0:20258:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226651008:12345-0@lo:400:kworker.0 Request processed in 35us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863918.573949:0:20258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1788863918.573962:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788863918.573965:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788863918.573983:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226650496:0@lo:400:kworker.0 00010000:00080000:1.0:1788863918.573993:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e543925c00 x1875759226651008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863918.574008:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226651008:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.574019:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226650112:0@lo:400:kworker.0 00000100:00100000:1.0:1788863918.574027:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226650624:0@lo:400:kworker.0 00000100:00100000:0.0:1788863918.574657:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226649600 00000100:00100000:0.0:1788863918.574665:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226649600 00000100:00100000:0.0:1788863918.574723:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788863918.574731:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3643:x1875759226649600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863918.574779:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3643:x1875759226649600:12345-0@lo:400:kworker.0 Request processed in 50us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863918.574785:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788863918.574828:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226649600:0@lo:400:kworker.0 00000100:00100000:3.0:1788863918.575850:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226649856 00000100:00100000:3.0:1788863918.575859:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226649856 00000100:00100000:3.0:1788863918.575918:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226650368 00000100:00100000:3.0:1788863918.575922:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226650368 00000100:00100000:3.0:1788863918.575952:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226649984 00000100:00100000:3.0:1788863918.575955:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226649984 00000100:00100000:3.0:1788863918.575973:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788863918.575981:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e541ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226649856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863918.576045:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e541ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226649856:12345-0@lo:400:kworker.0 Request processed in 65us (3389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863918.576052:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788863918.576109:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788863918.576116:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226650368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863918.576149:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226650368:12345-0@lo:400:kworker.0 Request processed in 34us (3434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863918.576155:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788863918.576166:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788863918.576172:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226649984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863918.576201:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226649984:12345-0@lo:400:kworker.0 Request processed in 29us (2597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863918.576207:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788863918.576247:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226649856:0@lo:400:kworker.0 00000100:00100000:3.0:1788863918.576258:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226650368:0@lo:400:kworker.0 00000100:00080000:0.0:1788863918.580144:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863918.580155:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863918.580196:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226651136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863918.580269:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863918.580364:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226649984:0@lo:400:kworker.0 00000100:00100000:2.0:1788863918.581419:0:19852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226651136 00000100:00100000:2.0:1788863918.581437:0:19852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226651136 00000100:00100000:2.0:1788863918.581525:0:19852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788863918.581538:0:19852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226651136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788863918.582272:0:19852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788863918.582395:0:19852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226651136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 858us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863918.582405:0:19852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788863918.582531:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226651136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788863919.083615:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788863919.083648:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226651264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788863919.083730:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863919.086692:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226651264 00000100:00100000:2.0:1788863919.086709:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226651264 00000100:00100000:2.0:1788863919.086817:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788863919.086828:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226651264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788863919.087278:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788863919.087381:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226651264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 554us (3649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863919.087388:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788863919.087521:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226651264:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788863919.407482:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863919.856313:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788863920.107395:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863920.107421:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226651392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788863920.107494:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863920.107594:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226651392 00000100:00100000:1.0:1788863920.107602:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226651392 00000100:00100000:1.0:1788863920.107660:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788863920.107670:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226651392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788863920.107705:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788863920.107759:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226651392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863920.107766:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788863920.107872:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226651392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788863920.108386:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788863920.108400:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226651520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788863920.108438:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863920.108671:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226651520 00000100:00100000:3.0:1788863920.108678:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226651520 00000100:00100000:3.0:1788863920.108718:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788863920.108725:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226651520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788863920.108748:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788863920.108794:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226651520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863920.108801:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788863920.108872:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226651520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788863920.109311:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226651648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788863920.109345:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863920.111161:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226651648 00000100:00100000:0.0:1788863920.111174:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226651648 00000100:00100000:0.0:1788863920.111257:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788863920.111269:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226651648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788863920.111295:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788863920.111393:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226651648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863920.111401:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788863920.111462:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226651648:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788863920.111770:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863920.240748:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863920.240796:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863920.240878:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863920.241142:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205599104 00000100:00100000:1.0:1788863920.241153:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205599104 00000100:00100000:1.0:1788863920.241221:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205599232 00000100:00100000:1.0:1788863920.241225:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205599232 00000100:00100000:1.0:1788863920.241251:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:1.0:1788863920.241261:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08218cea-68b5-4da7-b49c-21e1cc78e39d+14:2409:x1875759205599104:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863920.241277:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863920.241314:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64259b800/0xf569beb9d4b6a32d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188277 expref: 14 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863920.241333:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863920.241494:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08218cea-68b5-4da7-b49c-21e1cc78e39d+13:2409:x1875759205599104:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 233us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863920.241502:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:1.0:1788863920.241520:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:1.0:1788863920.241527:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08218cea-68b5-4da7-b49c-21e1cc78e39d+12:2408:x1875759205599232:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863920.241535:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863920.241545:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d99c00/0xf569beb9d4b6a334 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882a8 expref: 12 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863920.241554:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863920.241572:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:2408:x1875759205599232:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 45us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863920.241578:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:2.0:1788863920.242001:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205599616 00000100:00100000:2.0:1788863920.242007:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205599616 00000100:00100000:2.0:1788863920.242063:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 36 00000100:00100000:2.0:1788863920.242071:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+6:2407:x1875759205599616:12345-192.168.204.35@tcp:9:umount.0 00000020:00000080:2.0:1788863920.242141:0:19012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a350 00000020:00010000:2.0:1788863920.242149:0:19012:0:(genops.c:1920:obd_stale_export_put()) Put export ffff89e67d2b0000: total 0 00000100:00080000:2.0:1788863920.242153:0:19012:0:(import.c:65:import_set_state_nolock()) ffff89e67d2b4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788863920.242215:0:19012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788863920.242590:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2472872-203b-4543-b84a-9e24d2c107a6+4:2407:x1875759205599616:12345-192.168.204.35@tcp:9:umount.0 Request processed in 296us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863920.242600:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 36 00000020:00010000:0.0:1788863920.242815:0:17049:0:(genops.c:1906:obd_stale_export_get()) Get export ffff89e67d2b0000: total 0 00010000:00010000:0.0:1788863920.242820:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863920.242856:0:17049:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89e67d2b0000, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1788863920.242888:0:17049:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788863920.242902:0:17049:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788863920.242926:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000841441f6/0xf569beb9d4b6a6c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518843e expref: 3 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863920.242948:0:17049:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89e67d2b0000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788863920.242961:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863920.242963:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863920.242965:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788863920.243509:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788863920.243676:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863920.243730:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205599360 00000100:00100000:1.0:1788863920.243737:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205599360 00000100:00100000:1.0:1788863920.243805:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:1.0:1788863920.243812:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:2409:x1875759205599360:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863920.243824:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863920.243835:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3fe00/0xf569beb9d4b6a3b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518835e expref: 11 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863920.243846:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863920.243893:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:2409:x1875759205599360:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863920.243900:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:2.0:1788863920.266062:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863920.266552:0:20258:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205600512 00000100:00100000:1.0:1788863920.266563:0:20258:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205600512 00000100:00100000:0.0:1788863920.266767:0:20258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 76 00000100:00100000:0.0:1788863920.266779:0:20258:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2472872-203b-4543-b84a-9e24d2c107a6+12:2407:x1875759205600512:12345-192.168.204.35@tcp:39:umount.0 00000020:00000080:0.0:1788863920.266811:0:20258:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a342 00000020:00010000:0.0:1788863920.266826:0:20258:0:(genops.c:1920:obd_stale_export_put()) Put export ffff89e5448e1000: total 0 00000100:00080000:0.0:1788863920.266831:0:20258:0:(import.c:65:import_set_state_nolock()) ffff89e5448e4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788863920.266867:0:20258:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000100:00100000:0.0:1788863920.267046:0:20258:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2472872-203b-4543-b84a-9e24d2c107a6+11:2407:x1875759205600512:12345-192.168.204.35@tcp:39:umount.0 Request processed in 269us (993us total) trans 8589934636 rc 0/0 00000100:00100000:0.0:1788863920.267054:0:20258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 76 00000020:00010000:3.0:1788863920.267236:0:17048:0:(genops.c:1906:obd_stale_export_get()) Get export ffff89e5448e1000: total 0 00010000:00010000:3.0:1788863920.267282:0:17048:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89e5448e1000, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1788863920.267328:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e65d52e800) 00010000:00010000:3.0:1788863920.267332:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788863920.267340:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650922000/0xf569beb9d4b6a66e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518841b expref: 10 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863920.267363:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e671b75400) 00010000:00010000:3.0:1788863920.267365:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788863920.267370:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e64259bc00/0xf569beb9d4b6a429 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518836c expref: 9 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863920.267384:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:3.0:1788863920.267386:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788863920.267390:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98e00/0xf569beb9d4b6a613 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188406 expref: 8 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863920.267402:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e66270fa00) 00010000:00010000:3.0:1788863920.267404:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863920.267407:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6a468 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518837a expref: 7 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863920.267417:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e671b75d00) 00010000:00010000:3.0:1788863920.267419:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788863920.267423:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923c00/0xf569beb9d4b6a6d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188445 expref: 6 pid: 19853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863920.267437:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e65d52e300) 00010000:00010000:3.0:1788863920.267439:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788863920.267459:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98600/0xf569beb9d4b6a40d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188365 expref: 5 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863920.267475:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e66270f500) 00010000:00010000:3.0:1788863920.267477:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788863920.267480:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e650923600/0xf569beb9d4b6a4ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251883a4 expref: 4 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863920.267493:0:17048:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89e5448e1000, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1788863920.267506:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863920.267509:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863920.267510:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788863920.268666:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863920.286021:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863920.286148:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205600640 00000100:00100000:0.0:1788863920.286157:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205600640 00000100:00100000:0.0:1788863920.286295:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00100000:0.0:1788863920.286316:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+5:2407:x1875759205600640:12345-192.168.204.35@tcp:39:umount.0 00000020:00000080:0.0:1788863920.286346:0:17061:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a349 00000100:00080000:0.0:1788863920.286363:0:17061:0:(import.c:65:import_set_state_nolock()) ffff89e5448e5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788863920.286399:0:17061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788863920.286618:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2472872-203b-4543-b84a-9e24d2c107a6+3:2407:x1875759205600640:12345-192.168.204.35@tcp:39:umount.0 Request processed in 304us (606us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788863920.286626:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 77 00000100:00080000:1.0:1788863920.286847:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788863920.286902:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863920.429147:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863921.451254:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863922.476051:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863922.669320:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863922.669366:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863922.669411:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863922.669503:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205600768 00000100:00100000:0.0:1788863922.669514:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205600768 00000100:00100000:0.0:1788863922.669576:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 177 00000100:00100000:0.0:1788863922.669587:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:2410:x1875759205600768:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788863922.669677:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:2410:x1875759205600768:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 92us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863922.669684:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 177 00000100:00100000:3.0:1788863922.670101:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205601024 00000100:00100000:3.0:1788863922.670107:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205601024 00000100:00100000:3.0:1788863922.670160:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205600896 00000100:00100000:3.0:1788863922.670163:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205600896 00000100:00100000:3.0:1788863922.670185:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 108 00000100:00100000:3.0:1788863922.670192:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2410:x1875759205601024:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863922.670229:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2410:x1875759205601024:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 38us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863922.670235:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 108 00000100:00100000:3.0:1788863922.670246:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 109 00000100:00100000:3.0:1788863922.670263:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2410:x1875759205600896:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788863922.670285:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2410:x1875759205600896:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 33us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863922.670290:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 109 00000100:00080000:0.0:1788863922.670366:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788863922.670370:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788863923.499563:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863923.610400:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863923.610449:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863923.610485:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788863923.611065:0:17814:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205601152 00000100:00100000:1.0:1788863923.616307:0:17814:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205601152 00000100:00100000:1.0:1788863923.616403:0:17814:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205601408 00000100:00100000:1.0:1788863923.616409:0:17814:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205601408 00000100:00100000:1.0:1788863923.616424:0:17814:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205601280 00000100:00100000:1.0:1788863923.616427:0:17814:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205601280 00000100:00100000:1.0:1788863923.616447:0:17814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:1.0:1788863923.616456:0:17814:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08218cea-68b5-4da7-b49c-21e1cc78e39d+12:2408:x1875759205601152:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863923.616474:0:17814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863923.616495:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650922800/0xf569beb9d4b6a36c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251882e7 expref: 12 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863923.616529:0:17814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863923.616594:0:17814:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08218cea-68b5-4da7-b49c-21e1cc78e39d+11:2408:x1875759205601152:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 139us (6205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863923.616602:0:17814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:1.0:1788863923.616809:0:17814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:1.0:1788863923.616817:0:17814:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08218cea-68b5-4da7-b49c-21e1cc78e39d+10:2408:x1875759205601408:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863923.616827:0:17814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863923.616836:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650923800/0xf569beb9d4b6a3b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188357 expref: 10 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863923.616864:0:17814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863923.616887:0:17814:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08218cea-68b5-4da7-b49c-21e1cc78e39d+9:2408:x1875759205601408:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 70us (6436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863923.616893:0:17814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:1.0:1788863923.616907:0:17814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:1.0:1788863923.616913:0:17814:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08218cea-68b5-4da7-b49c-21e1cc78e39d+8:2408:x1875759205601280:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788863923.616921:0:17814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788863923.616931:0:17814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650922e00/0xf569beb9d4b6a373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188318 expref: 8 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863923.616945:0:17814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788863923.616964:0:17814:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08218cea-68b5-4da7-b49c-21e1cc78e39d+7:2408:x1875759205601280:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 52us (6478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863923.616970:0:17814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:2.0:1788863923.636319:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788863923.636409:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205601664 00000100:00100000:3.0:1788863923.636420:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205601664 00000100:00100000:3.0:1788863923.636487:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 78 00000100:00100000:3.0:1788863923.636498:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+6:2407:x1875759205601664:12345-192.168.204.35@tcp:39:umount.0 00000020:00000080:3.0:1788863923.636806:0:19853:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a381 00000020:00010000:3.0:1788863923.636817:0:19853:0:(genops.c:1920:obd_stale_export_put()) Put export ffff89e5425b4000: total 0 00000100:00080000:3.0:1788863923.636823:0:19853:0:(import.c:65:import_set_state_nolock()) ffff89e68084e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788863923.636898:0:19853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:3.0:1788863923.637061:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2407:x1875759205601664:12345-192.168.204.35@tcp:39:umount.0 Request processed in 564us (752us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1788863923.637071:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 78 00000020:00010000:2.0:1788863923.639503:0:17048:0:(genops.c:1906:obd_stale_export_get()) Get export ffff89e5425b4000: total 0 00010000:00010000:2.0:1788863923.639515:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863923.640004:0:17048:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89e5425b4000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788863923.640046:0:17048:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e66270fa00) 00010000:00010000:2.0:1788863923.640051:0:17048:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788863923.640063:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6a476 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188381 expref: 4 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863923.640227:0:17048:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89e5425b4000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788863923.640254:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863923.640257:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863923.640259:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863923.662758:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788863923.663250:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205601792 00000100:00100000:0.0:1788863923.663261:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205601792 00000100:00100000:0.0:1788863923.663357:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 79 00000100:00100000:0.0:1788863923.663368:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+5:2407:x1875759205601792:12345-192.168.204.35@tcp:39:umount.0 00000020:00000080:0.0:1788863923.663402:0:17061:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a388 00000100:00080000:0.0:1788863923.663412:0:17061:0:(import.c:65:import_set_state_nolock()) ffff89e68084d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788863923.663450:0:17061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788863923.663643:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d+3:2407:x1875759205601792:12345-192.168.204.35@tcp:39:umount.0 Request processed in 277us (895us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788863923.663652:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 79 00010000:00010000:1.0:1788863923.663710:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863923.691472:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226651776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863923.691550:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863923.691689:0:19852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226651776 00000100:00100000:1.0:1788863923.691697:0:19852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226651776 00000100:00100000:1.0:1788863923.691780:0:19852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788863923.691791:0:19852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226651776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863923.691828:0:19852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788863923.691880:0:19852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226651776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863923.691887:0:19852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788863923.691950:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863923.691992:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226651776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863923.692420:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226652032:0@lo:400:kworker.0 00000100:00100000:2.0:1788863923.692454:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863923.692484:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226652544:0@lo:400:kworker.0 00000100:00100000:2.0:1788863923.692504:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863923.692522:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226653056:0@lo:400:kworker.0 00000100:00100000:2.0:1788863923.692544:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863923.692566:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788863923.692572:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226652160:0@lo:400:kworker.0 00000100:00100000:2.0:1788863923.692596:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863923.692612:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226652672:0@lo:400:kworker.0 00000100:00100000:2.0:1788863923.692630:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863923.692646:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226653184:0@lo:400:kworker.0 00000100:00100000:2.0:1788863923.692684:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863923.692711:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226652032 00000100:00100000:2.0:1788863923.692716:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226652032 00000100:00100000:2.0:1788863923.692745:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226652544 00000100:00100000:2.0:1788863923.692748:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226652544 00000100:00100000:2.0:1788863923.692760:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788863923.692766:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226652032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863923.692808:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226652032:12345-0@lo:400:kworker.0 Request processed in 42us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863923.692815:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788863923.692828:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788863923.692834:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226652544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863923.692858:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226652544:12345-0@lo:400:kworker.0 Request processed in 24us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863923.692871:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788863923.692894:0:20258:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226653056 00000100:00100000:2.0:1788863923.692898:0:20258:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226653056 00000100:00100000:2.0:1788863923.692925:0:20258:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226653184 00000100:00100000:2.0:1788863923.692928:0:20258:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226653184 00000100:00100000:2.0:1788863923.692944:0:20258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788863923.692949:0:20258:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226653056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863923.692976:0:20258:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226653056:12345-0@lo:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863923.692981:0:20258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788863923.692991:0:20258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788863923.692996:0:20258:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226653184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863923.693016:0:20258:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875759226653184:12345-0@lo:400:kworker.0 Request processed in 20us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863923.693021:0:20258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788863923.693037:0:18570:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226652160 00000100:00100000:2.0:1788863923.693039:0:18570:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226652160 00000100:00100000:2.0:1788863923.693060:0:18570:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226652672 00000100:00100000:2.0:1788863923.693062:0:18570:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226652672 00000100:00100000:2.0:1788863923.693103:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788863923.693109:0:18570:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226652160:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788863923.693341:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788863923.693346:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788863923.693348:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863923.693384:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875759226653184:0@lo:400:kworker.0 00000100:00100000:1.0:1788863923.693395:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226652032:0@lo:400:kworker.0 00000100:00100000:1.0:1788863923.693403:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226652544:0@lo:400:kworker.0 00010000:00080000:1.0:1788863923.693413:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e6808ebb80 x1875759226653056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863923.693423:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226653056:0@lo:400:kworker.0 00000100:00100000:1.0:1788863923.693459:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788863923.693467:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226652672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863923.693503:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226652672:12345-0@lo:400:kworker.0 Request processed in 38us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863923.693509:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788863923.693536:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226652672:0@lo:400:kworker.0 00000100:00100000:2.0:1788863923.693625:0:18570:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226652160:12345-0@lo:400:kworker.0 Request processed in 516us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863923.693632:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788863923.693781:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226651904:0@lo:400:kworker.0 00000100:00100000:0.0:1788863923.693822:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863923.693852:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226652416:0@lo:400:kworker.0 00000100:00100000:0.0:1788863923.693876:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863923.693894:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226652928:0@lo:400:kworker.0 00000100:00100000:0.0:1788863923.693915:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863923.693933:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788863923.693948:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226652288:0@lo:400:kworker.0 00000100:00100000:0.0:1788863923.693973:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863923.693989:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226652800:0@lo:400:kworker.0 00000100:00100000:0.0:1788863923.694009:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863923.694024:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226653312:0@lo:400:kworker.0 00000100:00100000:0.0:1788863923.694044:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863923.694068:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226652416 00000100:00100000:0.0:1788863923.694072:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226652416 00000100:00100000:0.0:1788863923.694117:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226652928 00000100:00100000:0.0:1788863923.694133:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226652928 00000100:00100000:0.0:1788863923.694155:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226652800 00000100:00100000:0.0:1788863923.694158:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226652800 00000100:00100000:0.0:1788863923.694169:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226653312 00000100:00100000:0.0:1788863923.694171:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226653312 00000100:00100000:0.0:1788863923.694187:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788863923.694193:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226652416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863923.694247:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226652416:12345-0@lo:400:kworker.0 Request processed in 53us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863923.694253:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788863923.694267:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788863923.694273:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226652928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863923.694298:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226652928:12345-0@lo:400:kworker.0 Request processed in 26us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863923.694303:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788863923.694313:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788863923.694319:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226652800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863923.694339:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226652800:12345-0@lo:400:kworker.0 Request processed in 21us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863923.694351:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788863923.694364:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788863923.694370:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226653312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863923.694400:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226653312:12345-0@lo:400:kworker.0 Request processed in 30us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863923.694406:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788863923.694435:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226652800:0@lo:400:kworker.0 00010000:00080000:0.0:1788863923.694446:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e6808e9c00 x1875759226653312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863923.694456:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226653312:0@lo:400:kworker.0 00000100:00100000:0.0:1788863923.694466:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226652416:0@lo:400:kworker.0 00000100:00100000:0.0:1788863923.694475:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226652928:0@lo:400:kworker.0 00000100:00100000:3.0:1788863923.694877:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226652288 00000100:00100000:3.0:1788863923.694883:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226652288 00000100:00100000:3.0:1788863923.694926:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863923.694933:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226652288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863923.694967:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226652288:12345-0@lo:400:kworker.0 Request processed in 36us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863923.694974:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788863923.694992:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863923.695002:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226653440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788863923.695028:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863923.695055:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226653440 00000100:00100000:3.0:1788863923.695058:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226653440 00000100:00100000:3.0:1788863923.695102:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788863923.695109:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226653440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788863923.695132:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788863923.695163:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226653440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863923.695175:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788863923.695207:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226653440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788863923.695297:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226652288:0@lo:400:kworker.0 00000100:00080000:1.0:1788863923.695366:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788863923.695371:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863923.695372:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226651904 00000100:00080000:1.0:1788863923.695373:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788863923.695376:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226651904 00000100:00100000:1.0:1788863923.695404:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226652160:0@lo:400:kworker.0 00000100:00100000:2.0:1788863923.695412:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788863923.695428:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3641:x1875759226651904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863923.695476:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3641:x1875759226651904:12345-0@lo:400:kworker.0 Request processed in 49us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863923.695482:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788863923.695567:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226651904:0@lo:400:kworker.0 00000100:00100000:0.0:1788863923.765601:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788863923.767533:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205602048 00000100:00100000:2.0:1788863923.767547:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205602048 00000100:00100000:3.0:1788863923.771478:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 179 00000100:00100000:3.0:1788863923.771493:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+7:2407:x1875759205602048:12345-192.168.204.35@tcp:251:umount.0 00000020:00000080:3.0:1788863923.771551:0:17055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a31f 00000020:00010000:3.0:1788863923.771558:0:17055:0:(genops.c:1920:obd_stale_export_put()) Put export ffff89e5427b9800: total 0 00000100:00080000:3.0:1788863923.771563:0:17055:0:(import.c:65:import_set_state_nolock()) ffff89e679e3c800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788863923.771670:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08218cea-68b5-4da7-b49c-21e1cc78e39d+3:2407:x1875759205602048:12345-192.168.204.35@tcp:251:umount.0 Request processed in 178us (6077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863923.771679:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 179 00000020:00010000:0.0:1788863923.771755:0:17048:0:(genops.c:1906:obd_stale_export_get()) Get export ffff89e5427b9800: total 0 00010000:00010000:0.0:1788863923.771810:0:17048:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89e5427b9800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788863923.771845:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650923000/0xf569beb9d4b6a326 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188270 expref: 2 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863923.771861:0:17048:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89e5427b9800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788863923.771872:0:17048:0:(genops.c:885:class_export_put()) final put ffff89e5427b9800/08218cea-68b5-4da7-b49c-21e1cc78e39d 00010000:00010000:0.0:1788863923.771886:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863923.771888:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863923.771889:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788863923.771933:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5427b9800/08218cea-68b5-4da7-b49c-21e1cc78e39d for MGS 00000020:00000080:0.0:1788863923.771966:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e679e3c800 for MGS 00000100:00100000:0.0:1788863924.204517:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226653568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863924.204593:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863924.204702:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226653568 00000100:00100000:3.0:1788863924.204711:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226653568 00000100:00100000:3.0:1788863924.204767:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788863924.204776:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226653568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863924.204807:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788863924.204856:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226653568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863924.204863:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788863924.204910:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226653568:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788863924.526256:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788863925.099793:0:17098:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788863925.099803:0:17098:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788863925.099824:0:17098:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788863925.099833:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788863925.227800:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226653696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788863925.227871:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863925.227933:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226653696 00000100:00100000:0.0:1788863925.227941:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226653696 00000100:00100000:0.0:1788863925.227991:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788863925.228000:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226653696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788863925.228040:0:18128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788863925.228114:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226653696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863925.228121:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788863925.228171:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226653696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788863925.228304:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788863925.228316:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226653824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863925.228357:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863925.228391:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226653824 00000100:00100000:3.0:1788863925.228396:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226653824 00000100:00100000:3.0:1788863925.228427:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788863925.228435:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226653824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788863925.228456:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788863925.228491:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226653824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863925.228497:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788863925.228524:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226653824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788863925.229953:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226653952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788863925.230007:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863925.230255:0:19852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226653952 00000100:00100000:1.0:1788863925.230262:0:19852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226653952 00000100:00100000:1.0:1788863925.230317:0:19852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788863925.230326:0:19852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226653952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788863925.230344:0:19852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788863925.230384:0:19852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226653952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863925.230398:0:19852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788863925.230447:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788863925.230482:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226653952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788863925.550951:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788863925.743781:0:18564:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f2472872-203b-4543-b84a-9e24d2c107a6 00000020:00000080:3.0:1788863925.743791:0:18564:0:(genops.c:885:class_export_put()) final put ffff89e67d2b0000/f2472872-203b-4543-b84a-9e24d2c107a6 00000020:00000080:0.0:1788863925.743850:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67d2b0000/f2472872-203b-4543-b84a-9e24d2c107a6 for lustre-OST0000 00000020:00000080:0.0:1788863925.743905:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67d2b4000 for lustre-OST0000 00000001:00100000:3.0:1788863925.744106:0:17040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d 00000001:00080000:3.0:1788863925.744117:0:17040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:3.0:1788863925.744120:0:17040:0:(genops.c:885:class_export_put()) final put ffff89e5425b4000/83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d 00000001:00100000:3.0:1788863925.744129:0:17040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f2472872-203b-4543-b84a-9e24d2c107a6 00000001:00080000:3.0:1788863925.744133:0:17040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:3.0:1788863925.744135:0:17040:0:(genops.c:885:class_export_put()) final put ffff89e5448e1000/f2472872-203b-4543-b84a-9e24d2c107a6 00000020:00000080:2.0:1788863925.744177:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425b4000/83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d for lustre-MDT0000 00000020:00000080:2.0:1788863925.744226:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5448e1000/f2472872-203b-4543-b84a-9e24d2c107a6 for lustre-MDT0000 00000020:00000080:2.0:1788863925.744249:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e68084e800 for lustre-MDT0000 00000020:00000080:2.0:1788863925.744253:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5448e4800 for lustre-MDT0000 00000001:00100000:2.0:1788863925.746855:0:17793:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d 00000001:00080000:2.0:1788863925.746872:0:17793:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1788863925.746878:0:17793:0:(genops.c:885:class_export_put()) final put ffff89e68084e000/83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d 00000001:00100000:2.0:1788863925.746898:0:17793:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f2472872-203b-4543-b84a-9e24d2c107a6 00000001:00080000:2.0:1788863925.746902:0:17793:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1788863925.746904:0:17793:0:(genops.c:885:class_export_put()) final put ffff89e5448e3000/f2472872-203b-4543-b84a-9e24d2c107a6 00000020:00000080:0.0:1788863925.747009:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e68084e000/83e759dd-344a-4d67-a8c1-3cb4c5b6bf9d for lustre-MDT0001 00000020:00000080:0.0:1788863925.747061:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5448e3000/f2472872-203b-4543-b84a-9e24d2c107a6 for lustre-MDT0001 00000020:00000080:0.0:1788863925.747104:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e68084d800 for lustre-MDT0001 00000020:00000080:0.0:1788863925.747109:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5448e5000 for lustre-MDT0001 00010000:00010000:2.0:1788863926.571657:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788863926.587604:0:20634:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788863926.612472:0:20634:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788863926.612535:0:20634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863926.612580:0:20634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863926.612587:0:20634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863926.612593:0:20634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863926.612618:0:20634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788863926.612623:0:20634:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788863926.612652:0:20634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788863926.612656:0:20634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788863926.612661:0:20634:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788863926.612685:0:20634:0:(import.c:65:import_set_state_nolock()) ffff89e5425c8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788863926.612764:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226654080:0@lo:39:umount.0 00000100:00100000:2.0:1788863926.612829:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863926.613480:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226654080 00000100:00100000:3.0:1788863926.613489:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226654080 00000100:00100000:3.0:1788863926.613545:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788863926.613554:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875759226654080:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788863926.613595:0:17061:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69f13 00000100:00080000:3.0:1788863926.613603:0:17061:0:(import.c:65:import_set_state_nolock()) ffff89e543a44000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788863926.613668:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3639:x1875759226654080:12345-0@lo:39:umount.0 Request processed in 115us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863926.613675:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:3.0:1788863926.613684:0:17061:0:(genops.c:885:class_export_put()) final put ffff89e543a41000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788863926.613710:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543a41000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788863926.613752:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e543a44000 for lustre-MDT0000 00010000:00010000:0.0:1788863926.613878:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863926.613886:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.613905:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259a800 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863926.613909:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.613918:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863926.613926:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863926.613931:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788863926.613933:0:17048:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788863926.613936:0:17048:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788863926.613970:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.613976:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788863926.614007:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.614014:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e64259a800/0xf569beb9d4b69ee2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69ee9 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.614026:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863926.614028:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863926.614030:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863926.614038:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788863926.614049:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226654208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863926.614117:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863926.614193:0:17046:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226654208 00000100:00100000:0.0:1788863926.614198:0:17046:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226654208 00000100:00100000:0.0:1788863926.614235:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788863926.614243:0:17046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6586ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+24:3643:x1875759226654208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788863926.614524:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788863926.614542:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e641536c00/0xf569beb9d4b69ee9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b69ee2 expref: 24 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.614556:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788863926.614600:0:17046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6586ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:3643:x1875759226654208:12345-0@lo:103:ldlm_bl.0 Request processed in 358us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863926.614607:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788863926.614671:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226654208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863926.614834:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788863926.614859:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788863926.614889:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226654080:0@lo:39:umount.0 00000100:00080000:0.0:1788863926.615794:0:20634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788863926.615798:0:20634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788863926.615802:0:20634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788863926.617417:0:20634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.617435:0:20634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.617442:0:20634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.617448:0:20634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.617524:0:20634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863926.617548:0:20634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.617555:0:20634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.617573:0:20634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.617579:0:20634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.617847:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863926.617855:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.617863:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863926.617873:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.617883:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863926.617890:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863926.617896:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788863926.617899:0:17048:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788863926.617935:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.617941:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863926.617980:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.617988:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e641537000/0xf569beb9d4b69e33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69e3a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.618002:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863926.618005:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.618010:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99800 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863926.618013:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.618019:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863926.618037:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863926.618042:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788863926.618044:0:17048:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788863926.618067:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.618147:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863926.618189:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.618197:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863926.618198:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863926.618200:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863926.618217:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226654464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863926.618500:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863926.618584:0:17047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226654464 00000100:00100000:2.0:1788863926.618591:0:17047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226654464 00000100:00100000:2.0:1788863926.618642:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788863926.618651:0:17047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dea3065e-0e63-4370-a87c-9d4f07265d5e+23:3640:x1875759226654464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863926.618666:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863926.618682:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64259be00/0xf569beb9d4b6a246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b6a23f expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.618695:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863926.618730:0:17047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:3640:x1875759226654464:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863926.618746:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788863926.618785:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226654464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863926.618958:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863926.618970:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226654336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863926.619001:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863926.619456:0:17046:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226654336 00000100:00100000:2.0:1788863926.619462:0:17046:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226654336 00000100:00100000:2.0:1788863926.619494:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788863926.619501:0:17046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+22:3642:x1875759226654336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863926.619511:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863926.619522:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e641537a00/0xf569beb9d4b69e3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b69e33 expref: 22 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.619533:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863926.619585:0:17046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:3642:x1875759226654336:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863926.619591:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788863926.619696:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dea3065e-0e63-4370-a87c-9d4f07265d5e:3642:1875759226654336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788863926.621501:0:20634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788863926.621516:0:20634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d99800/0xf569beb9d4b6a23f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6a246 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863926.621535:0:20634:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788863926.623036:0:20634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.623052:0:20634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.623059:0:20634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.623066:0:20634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.623110:0:20634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788863926.623133:0:20634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.623141:0:20634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.623147:0:20634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.623153:0:20634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863926.623717:0:20634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788863926.623722:0:20634:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788863926.623728:0:20634:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788863926.623770:0:20634:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788863926.623773:0:20634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788863926.623778:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863926.623784:0:20634:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:0.0:1788863926.623792:0:20634:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff89e5448e5800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788863926.623797:0:20634:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff89e5427bd000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788863926.623802:0:20634:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff89e67b77e800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788863926.623806:0:20634:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff89e655c67800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788863926.623811:0:20634:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff89e65862b380) has exports, disconnecting them 00000020:00080000:0.0:1788863926.623816:0:20634:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89e5448e5800), last request at 1788863923 00000020:00000080:0.0:1788863926.623823:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a20e 00000100:00080000:0.0:1788863926.623839:0:20634:0:(import.c:65:import_set_state_nolock()) ffff89e5448e2000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788863926.623878:0:20634:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e5448e5800): rc 0 00000020:00000080:0.0:1788863926.623881:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e5448e5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788863926.623909:0:20634:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89e5427bd000), last request at 1788863923 00000020:00000080:0.0:1788863926.623913:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a0b0 00000100:00080000:0.0:1788863926.623918:0:20634:0:(import.c:65:import_set_state_nolock()) ffff89e5427b8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788863926.623925:0:20634:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e5427bd000): rc 0 00000020:00000080:0.0:1788863926.623928:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e5427bd000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788863926.623931:0:20634:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89e67b77e800), last request at 1788863837 00000020:00000080:0.0:1788863926.623934:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a001 00000100:00080000:0.0:1788863926.623937:0:20634:0:(import.c:65:import_set_state_nolock()) ffff89e67b77f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788863926.623941:0:20634:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e67b77e800): rc 0 00000020:00000080:0.0:1788863926.623943:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e67b77e800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788863926.623946:0:20634:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89e655c67800), last request at 1788863837 00000020:00000080:0.0:1788863926.623949:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69f98 00000100:00080000:0.0:1788863926.623952:0:20634:0:(import.c:65:import_set_state_nolock()) ffff89e544176000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788863926.623958:0:20634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00080000:0.0:1788863926.624033:0:20634:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e655c67800): rc 0 00000004:00000080:0.0:1788863926.624039:0:20634:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa4a9c85dbae0 00000100:00080000:0.0:1788863926.624056:0:20634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788863926.624060:0:20634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788863926.624884:0:20634:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788863926.624914:0:20634:0:(import.c:65:import_set_state_nolock()) ffff89e671be9000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788863926.625110:0:20634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788863926.625113:0:20634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1788863926.625125:0:20634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788863926.625189:0:20634:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788863926.625198:0:20634:0:(import.c:65:import_set_state_nolock()) ffff89e5425b0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788863926.625203:0:20634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788863926.625206:0:20634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1788863926.625216:0:20634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788863926.625281:0:20634:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788863926.625291:0:20634:0:(import.c:65:import_set_state_nolock()) ffff89e676341000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788863926.625329:0:20634:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff89e65862b380) has no exports 00000020:00000080:1.0:1788863926.625606:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5448e5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788863926.625659:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5427bd000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788863926.625675:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67b77e800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788863926.625695:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5448e2000 for lustre-MDT0000 00000020:00000080:1.0:1788863926.625699:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5427b8800 for lustre-MDT0000 00000020:00000080:1.0:1788863926.625701:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67b77f000 for lustre-MDT0000 00010000:00010000:2.0:1788863926.625869:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863926.625878:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.625888:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650923400 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863926.625892:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.625900:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863926.625907:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863926.625924:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788863926.625927:0:17049:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788863926.625930:0:17049:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788863926.625957:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.625963:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863926.625996:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.626003:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650923400/0xf569beb9d4b6a3ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6a3f1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.626014:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863926.626018:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.626023:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e641537e00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863926.626026:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.626033:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863926.626038:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863926.626043:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788863926.626045:0:17049:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788863926.626047:0:17049:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788863926.626066:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.626072:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863926.626111:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.626118:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e641537e00/0xf569beb9d4b69e25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69e2c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.626128:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863926.626130:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863926.626132:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863926.626148:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788863926.626168:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226655104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863926.626248:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863926.626391:0:17047:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226655104 00000100:00100000:2.0:1788863926.626399:0:17047:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226655104 00000100:00100000:2.0:1788863926.626445:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788863926.626454:0:17047:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dea3065e-0e63-4370-a87c-9d4f07265d5e+21:3643:x1875759226655104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863926.626468:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863926.626482:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e641537c00/0xf569beb9d4b69e2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b69e25 expref: 21 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.626493:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863926.626527:0:17047:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:3643:x1875759226655104:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863926.626534:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788863926.626646:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226655104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863926.626684:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226654592:0@lo:39:umount.0 00000100:00100000:2.0:1788863926.626714:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863926.626737:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226654720:0@lo:9:umount.0 00000100:00100000:2.0:1788863926.626759:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863926.626777:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226654848:0@lo:9:umount.0 00000100:00100000:2.0:1788863926.626796:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863926.626826:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226654592 00000100:00100000:2.0:1788863926.626830:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226654592 00000100:00100000:2.0:1788863926.626858:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788863926.626864:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875759226654592:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788863926.626888:0:17066:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a02b 00000100:00080000:2.0:1788863926.626895:0:17066:0:(import.c:65:import_set_state_nolock()) ffff89e676d88000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788863926.626915:0:17066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788863926.627053:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3639:x1875759226654592:12345-0@lo:39:umount.0 Request processed in 188us (337us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788863926.627059:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788863926.627102:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226654720 00000100:00100000:2.0:1788863926.627106:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226654720 00000100:00100000:2.0:1788863926.627131:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226654848 00000100:00100000:2.0:1788863926.627134:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226654848 00000100:00100000:2.0:1788863926.627160:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788863926.627167:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875759226654720:12345-0@lo:9:umount.0 00000100:00100000:0.0:1788863926.627403:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226654976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788863926.627436:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788863926.627716:0:19012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a0f6 00000100:00080000:2.0:1788863926.627725:0:19012:0:(import.c:65:import_set_state_nolock()) ffff89e64539d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788863926.627791:0:19012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788863926.627887:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3639:x1875759226654720:12345-0@lo:9:umount.0 Request processed in 720us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863926.627902:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788863926.627920:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788863926.627928:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875759226654848:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788863926.627940:0:19012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a24d 00000100:00080000:2.0:1788863926.627946:0:19012:0:(import.c:65:import_set_state_nolock()) ffff89e67d2b4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788863926.627963:0:19012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788863926.628035:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3639:x1875759226654848:12345-0@lo:9:umount.0 Request processed in 108us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863926.628041:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788863926.628110:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788863926.628125:0:17046:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226654976 00000100:00100000:2.0:1788863926.628129:0:17046:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226654976 00000100:00100000:2.0:1788863926.628167:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788863926.628186:0:17046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+20:3641:x1875759226654976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788863926.628196:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788863926.628211:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98400/0xf569beb9d4b6a3f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b6a3ea expref: 20 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863926.628225:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788863926.628253:0:17046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:3641:x1875759226654976:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863926.628581:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226654976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863926.628875:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788863926.628911:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e671be9000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788863926.628919:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226654592:0@lo:39:umount.0 00000100:00080000:2.0:1788863926.628929:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425b0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788863926.628979:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788863926.629966:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788863926.629973:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226654720:0@lo:9:umount.0 00000100:00080000:2.0:1788863926.629996:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676341000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788863926.630010:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788863926.630012:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788863926.630015:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226654848:0@lo:9:umount.0 00010000:00010000:2.0:1788863926.630047:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863926.630053:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788863926.637714:0:20634:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff89e65862b380) has no exports 00000020:00000080:0.0:1788863926.684851:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69e80 00000020:00000080:0.0:1788863926.684866:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e648f48800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788863926.684930:0:20634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788863926.685039:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788863926.685049:0:20634:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788863926.685054:0:20634:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff89e5428e8000) has no exports 00000020:00000080:2.0:1788863926.685523:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69e79 00000020:00000080:2.0:1788863926.685529:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e671be8000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788863926.688666:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e648f48800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788863926.688979:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788863926.688992:0:20634:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788863926.688997:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e671bea000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788863926.689001:0:20634:0:(genops.c:844:class_export_destroy()) destroying export ffff89e671bea000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788863926.689010:0:20634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788863926.689420:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e671be8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788863927.596628:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863928.619372:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788863928.811791:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226655232:0@lo:400:kworker.0 00000100:00100000:3.0:1788863928.811869:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863928.811922:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226655744:0@lo:400:kworker.0 00000100:00100000:3.0:1788863928.811948:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863928.811968:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226656256:0@lo:400:kworker.0 00000100:00100000:3.0:1788863928.811987:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863928.812008:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788863928.812014:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226655616:0@lo:400:kworker.0 00000100:00100000:3.0:1788863928.812050:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863928.812066:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226656128:0@lo:400:kworker.0 00000100:00100000:3.0:1788863928.812108:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863928.812146:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226655744 00000100:00100000:3.0:1788863928.812153:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226655744 00000100:00100000:3.0:1788863928.812191:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226656256 00000100:00100000:3.0:1788863928.812194:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226656256 00000100:00100000:3.0:1788863928.812220:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226656128 00000100:00100000:3.0:1788863928.812223:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226656128 00000100:00100000:3.0:1788863928.812235:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788863928.812243:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226656256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863928.812301:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226656256:12345-0@lo:400:kworker.0 Request processed in 58us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863928.812308:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788863928.812337:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788863928.812342:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875759226655744:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788863928.812359:0:19853:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788863928.813455:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875759226655744:12345-0@lo:400:kworker.0 Request processed in 1105us (1500us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788863928.813465:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788863928.813491:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788863928.813496:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875759226656128:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788863928.813501:0:19853:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788863928.813525:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875759226656128:12345-0@lo:400:kworker.0 Request processed in 28us (1416us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788863928.813530:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788863928.813590:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788863928.813596:0:3643:0:(import.c:65:import_set_state_nolock()) ffff89e5448e6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788863928.813600:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788863928.816184:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226655488:0@lo:400:kworker.0 00000100:00100000:0.0:1788863928.816263:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863928.816304:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226656000:0@lo:400:kworker.0 00000100:00100000:0.0:1788863928.816331:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863928.816361:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788863928.816380:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226655360:0@lo:400:kworker.0 00000100:00100000:0.0:1788863928.816406:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863928.816432:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226655872:0@lo:400:kworker.0 00000100:00100000:0.0:1788863928.816451:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863928.816485:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226656000 00000100:00100000:0.0:1788863928.816492:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226656000 00000100:00100000:0.0:1788863928.816536:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226655872 00000100:00100000:0.0:1788863928.816540:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226655872 00000100:00100000:0.0:1788863928.816554:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788863928.816562:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226656000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863928.816616:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226656000:12345-0@lo:400:kworker.0 Request processed in 55us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863928.816641:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788863928.816659:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788863928.816662:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875759226655872:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788863928.816669:0:17061:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788863928.816697:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875759226655872:12345-0@lo:400:kworker.0 Request processed in 33us (245us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788863928.816703:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788863928.816733:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788863928.816740:0:3641:0:(import.c:65:import_set_state_nolock()) ffff89e5425bf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788863928.816744:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788863928.816748:0:3641:0:(import.c:65:import_set_state_nolock()) ffff89e5425bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863928.816753:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 521 00000100:00080000:0.0:1788863928.816761:0:3641:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e5425bf000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863928.816787:0:3641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e681d00380 x1875759226656384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863928.816808:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226655872:0@lo:400:kworker.0 00010000:00080000:0.0:1788863928.816822:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e67f899880 x1875759226656000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863928.816833:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226656000:0@lo:400:kworker.0 00000100:00100000:0.0:1788863928.816887:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226655360 00000100:00100000:0.0:1788863928.816890:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226655360 00000100:00100000:0.0:1788863928.816910:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788863928.816916:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3641:x1875759226655360:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788863928.816920:0:18128:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788863928.816961:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3641:x1875759226655360:12345-0@lo:400:kworker.0 Request processed in 44us (554us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788863928.816967:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788863928.816991:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788863928.816994:0:3641:0:(import.c:65:import_set_state_nolock()) ffff89e544170000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788863928.816996:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788863928.817001:0:3641:0:(import.c:65:import_set_state_nolock()) ffff89e544170000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863928.817003:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 504 00000100:00080000:0.0:1788863928.817009:0:3641:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89e544170000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863928.817024:0:3641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e681d02a00 x1875759226656512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863928.817034:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226655360:0@lo:400:kworker.0 00000100:00100000:1.0:1788863928.822226:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226656640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863928.822300:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863928.822375:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226656640 00000100:00100000:1.0:1788863928.822382:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226656640 00000100:00100000:1.0:1788863928.822434:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788863928.822443:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226656640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788863928.822476:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788863928.822521:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226656640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863928.822529:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788863928.822579:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226656640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788863928.825336:0:17054:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226655232 00000100:00100000:2.0:1788863928.825352:0:17054:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226655232 00000100:00100000:2.0:1788863928.825437:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788863928.825447:0:17054:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:3643:x1875759226655232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863928.825533:0:17054:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:3643:x1875759226655232:12345-0@lo:400:kworker.0 Request processed in 88us (13664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863928.825542:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788863928.825585:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226655616 00000100:00100000:2.0:1788863928.825589:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226655616 00000100:00100000:2.0:1788863928.825628:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226655488 00000100:00100000:2.0:1788863928.825632:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226655488 00000100:00100000:2.0:1788863928.825668:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788863928.825676:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226655616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863928.825710:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226655616:12345-0@lo:400:kworker.0 Request processed in 36us (13660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863928.825716:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788863928.825728:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788863928.825734:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226655488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863928.825915:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226655488:12345-0@lo:400:kworker.0 Request processed in 33us (9503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863928.825923:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788863928.825942:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788863928.825946:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788863928.825949:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788863928.825975:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226656384:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788863928.826010:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863928.826038:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e681d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226656512:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788863928.826060:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863928.826138:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226656512 00000100:00100000:2.0:1788863928.826142:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226656512 00000100:00100000:2.0:1788863928.826161:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788863928.826166:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875759226656512:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788863928.826181:0:17066:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788863928.826832:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226655488:0@lo:400:kworker.0 00000100:00100000:1.0:1788863928.826990:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226656384 00000100:00100000:1.0:1788863928.826995:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226656384 00000100:00100000:1.0:1788863928.827025:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788863928.827059:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875759226656384:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788863928.827071:0:17061:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788863928.827160:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875759226656384:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 100us (1147us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788863928.827167:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788863928.827207:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788863928.827212:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788863928.827216:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226656384:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788863928.846711:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875759226656512:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 20536us (20642us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788863928.846725:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788863928.847009:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544170000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788863928.847015:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788863928.848106:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e681d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226656512:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788863928.861887:0:3643:0:(import.c:65:import_set_state_nolock()) ffff89e5448e6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788863928.861901:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 539 00000100:00080000:3.0:1788863928.861916:0:3643:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e5448e6000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863928.861953:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543925880 x1875759226656768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788863928.862000:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226656128:0@lo:400:kworker.0 00000100:00100000:3.0:1788863928.862125:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226655232:0@lo:400:kworker.0 00000100:00080000:3.0:1788863928.862153:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788863928.862156:0:3643:0:(import.c:65:import_set_state_nolock()) ffff89e676192800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788863928.862160:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788863928.862164:0:3643:0:(import.c:65:import_set_state_nolock()) ffff89e676192800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788863928.862175:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 505 00000100:00080000:3.0:1788863928.862180:0:3643:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89e676192800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863928.862194:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543927100 x1875759226656896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788863928.862205:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226655744:0@lo:400:kworker.0 00010000:00080000:3.0:1788863928.862225:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e68086ce00 x1875759226656256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863928.862234:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226656256:0@lo:400:kworker.0 00000100:00100000:3.0:1788863928.862263:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226655616:0@lo:400:kworker.0 00000100:00100000:2.0:1788863928.864240:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226656768:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788863928.864321:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863928.864528:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226656896:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788863928.864555:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863928.865065:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226656768 00000100:00100000:1.0:1788863928.865118:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226656768 00000100:00100000:1.0:1788863928.865174:0:17060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226656896 00000100:00100000:1.0:1788863928.865178:0:17060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226656896 00000100:00100000:1.0:1788863928.865274:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788863928.865283:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226656768:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788863928.865312:0:17060:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788863928.865368:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226656768:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 85us (1047us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788863928.865375:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788863928.865403:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788863928.865407:0:17060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226656896:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788863928.865414:0:17060:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788863928.865474:0:17060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226656896:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 65us (918us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788863928.865491:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788863928.877031:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5448e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863928.877044:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863928.877050:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226656768:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1788863928.877065:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676192800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863928.877069:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863928.877072:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226656896:0@lo:38:ptlrpcd_00_03.0 00000040:00080000:3.0:1788863929.067922:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788863929.323365:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863929.323392:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226657024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788863929.323464:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863929.323556:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226657024 00000100:00100000:3.0:1788863929.323572:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226657024 00000100:00100000:3.0:1788863929.323620:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788863929.323628:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226657024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788863929.323654:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788863929.323700:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226657024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863929.323706:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788863929.324008:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226657024:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788863929.644671:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863930.667435:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863931.691491:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863932.723237:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788863932.920450:0:18564:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788863932.920462:0:18564:0:(genops.c:885:class_export_put()) final put ffff89e645399800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788863932.920851:0:17040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788863932.920857:0:17040:0:(genops.c:885:class_export_put()) final put ffff89e655c67800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788863932.920990:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788863932.920995:0:19382:0:(genops.c:885:class_export_put()) final put ffff89e67d2b6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788863932.921266:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e645399800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788863932.921331:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e64539d800 for lustre-OST0000 00000001:00100000:3.0:1788863932.921605:0:17793:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788863932.921620:0:17793:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788863932.921624:0:17793:0:(genops.c:885:class_export_put()) final put ffff89e676d8d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788863932.921679:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e676d8d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788863932.921719:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e676d88000 for lustre-MDT0001 00000020:00000080:1.0:1788863932.922153:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e655c67800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788863932.922342:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67d2b6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788863932.923722:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e544176000 for lustre-MDT0000 00000020:00000080:1.0:1788863932.923741:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67d2b4800 for lustre-OST0001 00010000:00010000:2.0:1788863933.739499:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788863933.936845:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863933.936855:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788863933.936860:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e544170000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863933.936870:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 595 00000100:00080000:1.0:1788863933.936879:0:13187:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788863933.936908:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89e544170000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863933.936937:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863933.936963:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226657152:0@lo:400:kworker.0 00000100:00100000:1.0:1788863933.936963:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67f8ac700 x1875759226657280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863933.937054:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863933.937059:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788863933.937061:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e676192800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863933.937065:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 595 00000100:00080000:1.0:1788863933.937068:0:13187:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788863933.937073:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89e676192800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863933.937151:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67f8ae300 x1875759226657664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863933.937174:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863933.937177:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788863933.937179:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e5425bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863933.937183:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 595 00000100:00080000:1.0:1788863933.937186:0:13187:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788863933.937191:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e5425bf000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863933.937205:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544209180 x1875759226657792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863933.937221:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863933.937224:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788863933.937226:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e5448e6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863933.937230:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 595 00000100:00080000:1.0:1788863933.937233:0:13187:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788863933.937237:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e5448e6000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863933.937247:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544209880 x1875759226658048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863933.937310:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226657920:0@lo:400:kworker.0 00000100:00100000:2.0:1788863933.937382:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226657536:0@lo:400:kworker.0 00000100:00100000:0.0:1788863933.937617:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226658176:0@lo:400:kworker.0 00000100:00100000:1.0:1788863933.937660:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863933.937667:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226657280:0@lo:38:kworker.0 00000100:00100000:0.0:1788863933.937698:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863933.938073:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226657280 00000100:00100000:1.0:1788863933.938150:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226657280 00000100:00100000:1.0:1788863933.938250:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788863933.938259:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226657280:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788863933.938292:0:17065:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788863933.938326:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226657664:0@lo:38:kworker.0 00000100:00100000:0.0:1788863933.938362:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863933.938394:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226657792:0@lo:38:kworker.0 00000100:00100000:0.0:1788863933.938417:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863933.938435:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226658048:0@lo:38:kworker.0 00000100:00100000:0.0:1788863933.938459:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863933.938494:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226657920 00000100:00100000:0.0:1788863933.938498:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226657920 00000100:00100000:0.0:1788863933.938553:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226657664 00000100:00100000:0.0:1788863933.938557:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226657664 00000100:00100000:0.0:1788863933.938567:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226657792 00000100:00100000:0.0:1788863933.938570:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226657792 00000100:00100000:0.0:1788863933.938577:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226658048 00000100:00100000:0.0:1788863933.938580:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226658048 00000100:00100000:0.0:1788863933.938589:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788863933.938598:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226657920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863933.938660:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226657920:12345-0@lo:400:kworker.0 Request processed in 64us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863933.938667:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788863933.938687:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788863933.938692:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1875759226657664:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788863933.938699:0:19853:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788863933.938731:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1875759226657664:12345-0@lo:38:kworker.0 Request processed in 38us (368us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788863933.938736:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788863933.938748:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788863933.938752:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1875759226657792:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788863933.938758:0:19853:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788863933.938809:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1875759226657792:12345-0@lo:38:kworker.0 Request processed in 55us (390us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788863933.938816:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788863933.938840:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788863933.938844:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1875759226658048:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788863933.938850:0:19853:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788863933.938873:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1875759226658048:12345-0@lo:38:kworker.0 Request processed in 27us (413us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788863933.938879:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788863933.938902:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788863933.938936:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676192800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863933.938943:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863933.938947:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226657664:0@lo:38:kworker.0 00000100:00080000:0.0:1788863933.938958:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863933.938961:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863933.938964:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226657792:0@lo:38:kworker.0 00000100:00080000:0.0:1788863933.939359:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5448e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863933.939366:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863933.939370:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226658048:0@lo:38:kworker.0 00000100:00100000:0.0:1788863933.939442:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863933.939490:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863933.939500:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226657408:0@lo:400:kworker.0 00000100:00100000:0.0:1788863933.939547:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863933.939581:0:18568:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226657408 00000100:00100000:0.0:1788863933.939586:0:18568:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226657408 00000100:00100000:0.0:1788863933.939637:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788863933.939646:0:18568:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f8ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226657408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863933.939716:0:18568:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f8ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226657408:12345-0@lo:400:kworker.0 Request processed in 58us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863933.939724:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788863933.939747:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863933.939770:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226657408:0@lo:400:kworker.0 00000100:00100000:0.0:1788863933.939787:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226658176 00000100:00100000:0.0:1788863933.939790:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226658176 00000100:00100000:0.0:1788863933.939820:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788863933.939826:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67f899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226658176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863933.939861:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67f899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226658176:12345-0@lo:400:kworker.0 Request processed in 36us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863933.939868:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1788863933.939885:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788863933.939905:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54420bb80 x1875759226658176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863933.939918:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226658176:0@lo:400:kworker.0 00010000:00080000:0.0:1788863933.939982:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544209500 x1875759226657920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863933.939993:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226657920:0@lo:400:kworker.0 00000100:00100000:0.0:1788863933.940617:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863933.940632:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67f8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226658304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788863933.940676:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863933.940811:0:19852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226658304 00000100:00100000:0.0:1788863933.940818:0:19852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226658304 00000100:00100000:0.0:1788863933.940882:0:19852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788863933.940908:0:19852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226658304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788863933.940939:0:19852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788863933.942337:0:19852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226658304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1420us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863933.942352:0:19852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788863933.942401:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788863933.942460:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226658304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863933.944551:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863933.949679:0:17055:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226657152 00000100:00100000:0.0:1788863933.949703:0:17055:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226657152 00000100:00100000:0.0:1788863933.949873:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788863933.949887:0:17055:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e681e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:3643:x1875759226657152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863933.950186:0:17055:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:3643:x1875759226657152:12345-0@lo:400:kworker.0 Request processed in 302us (5644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863933.950405:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863933.950452:0:19012:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226657536 00000100:00100000:2.0:1788863933.950458:0:19012:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226657536 00000100:00100000:2.0:1788863933.950504:0:19012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788863933.950506:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788863933.950512:0:19012:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226657536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863933.950552:0:19012:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226657536:12345-0@lo:400:kworker.0 Request processed in 41us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863933.950558:0:19012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788863933.950651:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226657536:0@lo:400:kworker.0 00000100:00100000:3.0:1788863933.950741:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226657152:0@lo:400:kworker.0 00000100:00100000:3.0:1788863933.957175:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e681d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226657280:12345-0@lo:38:kworker.0 Request processed in 18890us (19451us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788863933.957220:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1788863933.957661:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544170000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788863933.957714:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788863933.957719:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67f8ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226657280:0@lo:38:kworker.0 00000100:00100000:0.0:1788863934.443345:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863934.443371:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226658432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863934.443452:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863934.448302:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226658432 00000100:00100000:1.0:1788863934.448318:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226658432 00000100:00100000:1.0:1788863934.448395:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788863934.448404:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226658432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788863934.448435:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788863934.448543:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226658432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (5091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863934.448550:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788863934.448646:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226658432:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788863934.766894:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863935.787440:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863936.812628:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863937.835755:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863938.859310:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788863939.051339:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863939.051346:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788863939.051351:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e544170000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863939.051358:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 601 00000100:00080000:1.0:1788863939.051365:0:13187:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788863939.051376:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89e544170000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863939.051400:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544208380 x1875759226658688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863939.051458:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863939.051461:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788863939.051463:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e676192800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863939.051466:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 601 00000100:00080000:1.0:1788863939.051470:0:13187:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788863939.051474:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89e676192800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863939.051486:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544208e00 x1875759226659072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863939.051510:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863939.051513:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788863939.051515:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e5425bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863939.051518:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 601 00000100:00080000:1.0:1788863939.051521:0:13187:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788863939.051526:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e5425bf000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863939.051538:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544208700 x1875759226659200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788863939.051553:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863939.051555:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788863939.051557:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e5448e6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863939.051560:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 601 00000100:00080000:1.0:1788863939.051563:0:13187:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788863939.051572:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e5448e6000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863939.051583:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544209500 x1875759226659456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788863939.054125:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226659328:0@lo:400:kworker.0 00000100:00100000:3.0:1788863939.054212:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863939.054290:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788863939.054298:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226658560:0@lo:400:kworker.0 00000100:00100000:3.0:1788863939.054328:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863939.054355:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226659584:0@lo:400:kworker.0 00000100:00100000:3.0:1788863939.054377:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863939.054408:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226658944:0@lo:400:kworker.0 00000100:00100000:3.0:1788863939.054433:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863939.054594:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226658816:0@lo:400:kworker.0 00000100:00100000:0.0:1788863939.054637:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226659328 00000100:00100000:0.0:1788863939.054645:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226659328 00000100:00100000:0.0:1788863939.054710:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226659584 00000100:00100000:0.0:1788863939.054713:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226659584 00000100:00100000:0.0:1788863939.054739:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788863939.054748:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226659328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863939.054813:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226659328:12345-0@lo:400:kworker.0 Request processed in 67us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863939.054836:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788863939.054855:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788863939.054861:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226659584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863939.054892:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875759226659584:12345-0@lo:400:kworker.0 Request processed in 31us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863939.054897:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788863939.054973:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788863939.054995:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226658688:0@lo:38:kworker.0 00000100:00100000:0.0:1788863939.055029:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863939.055048:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226659072:0@lo:38:kworker.0 00000100:00100000:0.0:1788863939.055068:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863939.055102:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226659200:0@lo:38:kworker.0 00000100:00100000:0.0:1788863939.055128:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863939.055145:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226659456:0@lo:38:kworker.0 00000100:00100000:0.0:1788863939.055165:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863939.055192:0:18128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226658688 00000100:00100000:0.0:1788863939.055196:0:18128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226658688 00000100:00100000:0.0:1788863939.055216:0:18128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788863939.055221:0:18128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e64803f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1875759226658688:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788863939.055237:0:18128:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:00080000:2.0:1788863939.056215:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54420bb80 x1875759226659584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863939.056231:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226659584:0@lo:400:kworker.0 00010000:00080000:2.0:1788863939.056244:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544209c00 x1875759226659328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863939.056252:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226659328:0@lo:400:kworker.0 00000100:00100000:2.0:1788863939.056297:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226659072 00000100:00100000:2.0:1788863939.056302:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226659072 00000100:00100000:2.0:1788863939.056328:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226659200 00000100:00100000:2.0:1788863939.056330:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226659200 00000100:00100000:2.0:1788863939.056338:0:17061:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226659456 00000100:00100000:2.0:1788863939.056341:0:17061:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226659456 00000100:00100000:2.0:1788863939.056351:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788863939.056357:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875759226659072:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788863939.056369:0:17061:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788863939.056415:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875759226659072:12345-0@lo:38:kworker.0 Request processed in 58us (1346us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788863939.056423:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788863939.056437:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788863939.056441:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875759226659200:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788863939.056447:0:17061:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788863939.056470:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875759226659200:12345-0@lo:38:kworker.0 Request processed in 27us (1341us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788863939.056485:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788863939.056498:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788863939.056501:0:17061:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875759226659456:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788863939.056509:0:17061:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788863939.056535:0:17061:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875759226659456:12345-0@lo:38:kworker.0 Request processed in 32us (1369us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788863939.056540:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1788863939.056568:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676192800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863939.056573:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788863939.056576:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226659072:0@lo:38:kworker.0 00000100:00080000:2.0:1788863939.056585:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863939.056588:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788863939.056591:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226659200:0@lo:38:kworker.0 00000100:00080000:2.0:1788863939.056657:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5448e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863939.056662:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788863939.056665:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226659456:0@lo:38:kworker.0 00000100:00100000:3.0:1788863939.057029:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788863939.057041:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226659712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788863939.057088:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788863939.057138:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226659712 00000100:00100000:3.0:1788863939.057142:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226659712 00000100:00100000:3.0:1788863939.057178:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788863939.057185:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226659712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788863939.057208:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788863939.057244:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226659712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863939.057251:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788863939.057295:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226659712:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788863939.057319:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788863939.059481:0:18570:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226658944 00000100:00100000:1.0:1788863939.059495:0:18570:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226658944 00000100:00100000:1.0:1788863939.059628:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788863939.059642:0:18570:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226658944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863939.059644:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863939.059725:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226658816 00000100:00100000:1.0:1788863939.059728:0:18570:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226658944:12345-0@lo:400:kworker.0 Request processed in 91us (5292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863939.059731:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226658816 00000100:00100000:1.0:1788863939.059739:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788863939.059768:0:17053:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226658560 00000100:00100000:2.0:1788863939.059784:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788863939.059785:0:17053:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226658560 00000100:00100000:2.0:1788863939.059797:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226658816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863939.059827:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788863939.059835:0:17053:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:3640:x1875759226658560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788863939.059845:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226658816:12345-0@lo:400:kworker.0 Request processed in 50us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788863939.059852:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788863939.059875:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788863939.059884:0:17053:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dea3065e-0e63-4370-a87c-9d4f07265d5e+19:3640:x1875759226658560:12345-0@lo:400:kworker.0 Request processed in 50us (5554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863939.059893:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788863939.059920:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226658816:0@lo:400:kworker.0 00000100:00100000:2.0:1788863939.059984:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226658944:0@lo:400:kworker.0 00000100:00100000:1.0:1788863939.060062:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226658560:0@lo:400:kworker.0 00000100:00100000:0.0:1788863939.087433:0:18128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e64803f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1875759226658688:12345-0@lo:38:kworker.0 Request processed in 32201us (32394us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788863939.087457:0:18128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788863939.088487:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544170000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863939.088495:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788863939.088500:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226658688:0@lo:38:kworker.0 00000040:00080000:3.0:1788863939.311043:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788863939.564566:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863939.564592:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226659840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788863939.564694:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863939.564986:0:19852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226659840 00000100:00100000:1.0:1788863939.564995:0:19852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226659840 00000100:00100000:1.0:1788863939.565054:0:19852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788863939.565064:0:19852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226659840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788863939.565126:0:19852:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788863939.565183:0:19852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226659840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863939.565191:0:19852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788863939.565701:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226659840:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788863939.883572:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863940.907689:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:2.0:1788863941.099623:0:20634:0:(genops.c:1851:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? 00000020:01000000:2.0:1788863941.111644:0:20634:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e681ad51e0 - data ffff89e671f28510/ffff89e542556000 00000020:01000000:2.0:1788863941.112040:0:20634:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e542af6480 - data ffff89e671d99d80/ffff89e67d2db800 00000001:00000004:2.0:1788863941.122483:0:20634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:2.0:1788863941.226346:0:20634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788863941.226359:0:20634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788863941.226378:0:20634:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff89e67f89aa00 x1875759226654592/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788863936 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863941.226413:0:20634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788863941.235912:0:20634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788863941.235922:0:20634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1788863941.235972:0:20634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788863941.235976:0:20634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788863941.241173:0:17084:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788863941.241186:0:17084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:2.0:1788863941.241213:0:17084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788863941.242150:0:20634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788863941.242157:0:20634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1788863941.242174:0:20634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788863941.242177:0:20634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788863941.247022:0:17086:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788863941.247034:0:17086:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:2.0:1788863941.247057:0:17086:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788863941.248637:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69e48 00000020:00000080:1.0:1788863941.248650:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e680de4800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788863941.250174:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e680de4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788863941.250945:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69e5d 00000020:00000080:1.0:1788863941.250957:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e680de0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788863941.251068:0:20634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788863941.251109:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863941.251119:0:20634:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788863941.251125:0:20634:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff89e6586299c0) has no exports 00000004:01000000:1.0:1788863941.251320:0:20634:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788863941.251330:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69ebf 00000020:00000080:1.0:1788863941.251335:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e5425b7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788863941.255280:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e680de0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788863941.261175:0:20634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788863941.261195:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863941.261210:0:20634:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788863941.261217:0:20634:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff89e6763c0000) has no exports 00000020:00000080:1.0:1788863941.261230:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69eb8 00000020:00000080:1.0:1788863941.261242:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e676341800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788863941.261761:0:20634:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788863941.261951:0:20634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788863941.261957:0:20634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788863941.261965:0:20634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788863941.261967:0:20634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788863941.262014:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863941.262021:0:20634:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788863941.262030:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69eaa 00000020:00000080:1.0:1788863941.262036:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e648f4c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788863941.262040:0:20634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788863941.262045:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863941.262048:0:20634:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788863941.262051:0:20634:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff89e543a199c0) has no exports 00000020:00000080:1.0:1788863941.262056:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69ea3 00000020:00000080:1.0:1788863941.262059:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e5425b3800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788863941.262570:0:20634:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788863941.262574:0:20634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788863941.262577:0:20634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1788863941.262581:0:20634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788863941.262583:0:20634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788863941.262696:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863941.262701:0:20634:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788863941.262718:0:20634:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788863941.262725:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69e95 00000020:00000080:1.0:1788863941.262730:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e648f49800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788863941.262735:0:20634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788863941.262738:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863941.262741:0:20634:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788863941.262743:0:20634:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff89e5428ecd40) has no exports 00000020:00000080:1.0:1788863941.262748:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69e8e 00000020:00000080:1.0:1788863941.262751:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e671be8800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788863941.263728:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425b7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788863941.263744:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e676341800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788863941.263750:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e676341000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788863941.263760:0:37:0:(genops.c:885:class_export_put()) final put ffff89e648f4f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788863941.263763:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e648f4f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788863941.263786:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788863941.263896:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e648f4c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788863941.263900:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425b3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788863941.263905:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5425b0800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788863941.263909:0:37:0:(genops.c:885:class_export_put()) final put ffff89e648f4a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788863941.263912:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e648f4a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788863941.263915:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788863941.263941:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e648f49800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788863941.263948:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e671be8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788863941.368371:0:20634:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788863941.368384:0:20634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788863941.368390:0:20634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788863941.368402:0:20634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788863941.368593:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863941.368608:0:20634:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788863941.368645:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863941.368649:0:20634:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788863941.368656:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e680c20800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788863941.368662:0:20634:0:(genops.c:844:class_export_destroy()) destroying export ffff89e680c20800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788863941.368676:0:20634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788863941.368896:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69e64 00000020:00000080:1.0:1788863941.368907:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e680de4000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788863941.368913:0:20634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788863941.368918:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863941.368924:0:20634:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788863941.368928:0:20634:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff89e65862cd40) has no exports 00000020:00000080:1.0:1788863941.368953:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863941.368956:0:20634:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788863941.368961:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69e6b 00000020:00000080:1.0:1788863941.368965:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e680de2800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788863941.368988:0:20634:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e5448c2800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788863941.368992:0:20634:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e5448c2800 3 00000020:01000004:1.0:1788863941.368995:0:20634:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e5448c2800 from lustre-MDT0000 00000020:00000080:1.0:1788863941.369021:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863941.369025:0:20634:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788863941.369028:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e680de1800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788863941.369031:0:20634:0:(genops.c:844:class_export_destroy()) destroying export ffff89e680de1800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788863941.369040:0:20634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788863941.369070:0:20634:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788863941.369379:0:20634:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788863941.369383:0:20634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788863941.369387:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863941.369390:0:20634:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788863941.369398:0:20634:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff89e67f895000 dea3065e-0e63-4370-a87c-9d4f07265d5e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788863941.369405:0:20634:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff89e543a1b380) has exports, disconnecting them 00000020:00080000:1.0:1788863941.369410:0:20634:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89e67f895000), last request at 1788863823 00000020:00000080:1.0:1788863941.369429:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69e10 00000020:00010000:1.0:1788863941.369433:0:20634:0:(genops.c:1920:obd_stale_export_put()) Put export ffff89e67f895000: total 2 00000100:00080000:1.0:1788863941.369560:0:20634:0:(import.c:65:import_set_state_nolock()) ffff89e67f896000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788863941.369579:0:20634:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e67f895000): rc 0 00000020:00080000:1.0:1788863941.369584:0:20634:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff89e543a1b380) has no exports 00000020:00000080:3.0:1788863941.369626:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e671be9000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788863941.369636:0:37:0:(genops.c:885:class_export_put()) final put ffff89e648f4e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788863941.369639:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e648f4e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788863941.369653:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000100:00100000:1.0:1788863941.369665:0:17053:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff89e6762eac00:17053] 0 exiting: rc = 1 00000020:00000080:3.0:1788863941.369732:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e680de4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788863941.369737:0:37:0:(genops.c:885:class_export_put()) final put ffff89e680de7800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788863941.369739:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e680de7800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788863941.369745:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788863941.369795:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e680de2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788863941.369825:0:17054:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff89e542764c00:17054] 1 exiting: rc = 0 00000100:00100000:1.0:1788863941.369925:0:17055:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff89e542765400:17055] 2 exiting: rc = 0 00000100:00100000:1.0:1788863941.369999:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370008:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370015:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370021:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370031:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370167:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370178:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370247:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370263:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370277:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370287:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370294:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370300:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370372:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370379:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370386:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370392:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370398:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370405:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370411:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370419:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370424:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370430:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370436:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370441:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:2.0:1788863941.370567:0:17048:0:(genops.c:1906:obd_stale_export_get()) Get export ffff89e67f895000: total 0 00010000:00010000:2.0:1788863941.370574:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863941.370574:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370584:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370590:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370596:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370603:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370609:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370620:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788863941.370626:0:17048:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff89e67f895000, canceled 0 locks, left on hash table 13. 00000100:00100000:1.0:1788863941.370632:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370639:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370644:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370653:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370660:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788863941.370667:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d99400/0xf569beb9d4b69f2f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b69f28 expref: 14 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863941.370668:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370678:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370688:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370697:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788863941.370707:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64259ac00/0xf569beb9d4b69fec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b69fe5 expref: 13 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863941.370710:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370721:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788863941.370727:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650922400/0xf569beb9d4b69f3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b69f36 expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863941.370734:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788863941.370745:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650923200/0xf569beb9d4b69f4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b69f44 expref: 11 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863941.370753:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788863941.370758:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3ea00/0xf569beb9d4b6a1f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b6a1f2 expref: 10 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788863941.370766:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370773:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370783:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788863941.370795:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d99200/0xf569beb9d4b69e1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b69e17 expref: 9 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863941.370806:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d99e00/0xf569beb9d4b6a238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b6a231 expref: 8 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863941.370819:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98c00/0xf569beb9d4b6a3e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b6a3dc expref: 7 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863941.370830:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98a00/0xf569beb9d4b6a09b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b6a094 expref: 6 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863941.370841:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d99600/0xf569beb9d4b6a3c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b6a3c0 expref: 5 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863941.370850:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3f600/0xf569beb9d4b6a3d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b6a3ce expref: 4 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863941.370874:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e650923a00/0xf569beb9d4b6a1cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b6a1c8 expref: 3 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863941.370906:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b6a071 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf569beb9d4b6a06a expref: 2 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863941.370917:0:17048:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff89e67f895000, canceled 13 locks, left on hash table 0. 00000100:00100000:1.0:1788863941.370934:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788863941.370935:0:17048:0:(genops.c:885:class_export_put()) final put ffff89e67f895000/dea3065e-0e63-4370-a87c-9d4f07265d5e 00000100:00100000:1.0:1788863941.370946:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370954:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788863941.370957:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863941.370962:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863941.370963:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788863941.370965:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863941.370972:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370981:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370991:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.370998:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.371004:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.371010:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.371016:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.371025:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.371031:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.371048:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.371055:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863941.371061:0:20634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788863941.371144:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67f895000/dea3065e-0e63-4370-a87c-9d4f07265d5e for MGS 00000020:00000080:3.0:1788863941.371182:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67f896000 for MGS 00000020:01000000:2.0:1788863941.377758:0:20634:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e67ac1cd80 - data ffff89e671f081b0/ffff89e67cc59800 00000020:01000000:2.0:1788863941.378507:0:20634:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e543adf600 - data ffff89e671e6e510/ffff89e54394ec00 00000020:00000080:3.0:1788863941.384445:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69df4 00000020:00000080:3.0:1788863941.384471:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e67f891000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788863941.384495:0:20634:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e5448c2800 from MGS, refs=2 00000020:01000004:3.0:1788863941.384499:0:20634:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e5448c2800 2 00000020:01000004:3.0:1788863941.384503:0:20634:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e5448c2800 from MGS 00000020:00000080:3.0:1788863941.384709:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863941.384718:0:20634:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788863941.384722:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e67f892800/MGS 00000020:00000080:3.0:1788863941.384726:0:20634:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67f892800/MGS for MGS 00000020:01000000:3.0:1788863941.384734:0:20634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788863941.384820:0:20634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788863941.384824:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863941.384831:0:20634:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788863941.384848:0:20634:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89e5425c9000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788863941.384855:0:20634:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff89e658628000) has exports, disconnecting them 00000020:00080000:3.0:1788863941.384861:0:20634:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89e5425c9000), last request at 1788863823 00000020:00000080:3.0:1788863941.384865:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69ef7 00000020:00080000:3.0:1788863941.384878:0:20634:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e5425c9000): rc 0 00000020:00000080:3.0:1788863941.384894:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e5425c9000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788863941.388324:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67f891000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788863941.388355:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425c9000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788863941.389758:0:20634:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788863941.389949:0:20634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788863941.389955:0:20634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788863941.389963:0:20634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788863941.390151:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5425c8800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788863941.390351:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788863941.390362:0:20634:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788863941.390368:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e5425cd000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788863941.390372:0:20634:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425cd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788863941.390380:0:20634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788863941.390602:0:20634:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e5448c2800 1 00000020:00000080:2.0:1788863941.390610:0:20634:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69de6 00000020:00000080:2.0:1788863941.390619:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e67f896800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788863941.390663:0:20634:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788863941.390668:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788863941.390674:0:20634:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788863941.390690:0:20634:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff89e5428eb380) has no exports 00000020:00000080:1.0:1788863941.398159:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67f896800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788863941.843205:0:20634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863941.843224:0:20634:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788863941.843233:0:20634:0:(genops.c:885:class_export_put()) final put ffff89e5448c7800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788863941.843239:0:20634:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5448c7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788863941.843258:0:20634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788863941.843422:0:20634:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89e5448c5000 00000020:02000400:1.0:1788863941.843505:0:20634:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788863941.936719:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863942.963361:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863943.979439:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863944.171659:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226659968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863944.171738:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863944.171766:0:18572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226659968 00000100:00100000:2.0:1788863944.171774:0:18572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226659968 00000100:00100000:2.0:1788863944.171927:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788863944.171927:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863944.171931:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788863944.171934:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e544170000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788863944.171937:0:18572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226659968:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788863944.171939:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 606 00000100:00080000:0.0:1788863944.171944:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788863944.171952:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89e544170000 using connection 192.168.204.135@tcp/0@lo 00002000:00000024:2.0:1788863944.171965:0:18572:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788863944.171969:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e6808e9500 x1875759226660224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863944.171998:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1788863944.172002:0:18572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226659968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (265us total) trans 0 rc 0/0 00000100:00080000:0.0:1788863944.172002:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788863944.172004:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e676192800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863944.172007:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 606 00000100:00080000:0.0:1788863944.172009:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788863944.172013:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89e676192800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863944.172022:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788863944.172024:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4baa00 x1875759226660480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863944.172032:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863944.172035:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788863944.172037:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e5425bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863944.172039:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 606 00000100:00080000:0.0:1788863944.172042:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788863944.172043:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863944.172053:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e5425bf000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863944.172065:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4b8e00 x1875759226660608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788863944.172067:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226660224:0@lo:38:kworker.0 00000100:00080000:0.0:1788863944.172107:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863944.172110:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788863944.172112:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e5448e6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863944.172115:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 606 00000100:00080000:0.0:1788863944.172118:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788863944.172122:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e5448e6000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863944.172140:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863944.172143:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4b9500 x1875759226660864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788863944.172159:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226660480:0@lo:38:kworker.0 00000100:00100000:2.0:1788863944.172181:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863944.172200:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226660608:0@lo:38:kworker.0 00000100:00100000:2.0:1788863944.172218:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863944.172232:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226660864:0@lo:38:kworker.0 00000100:00100000:2.0:1788863944.172248:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863944.172274:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226660224 00000100:00100000:2.0:1788863944.172278:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226660224 00000100:00100000:2.0:1788863944.172296:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788863944.172301:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875759226660224:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788863944.172303:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226660352:0@lo:400:kworker.0 00010000:00020000:2.0:1788863944.172317:0:17066:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788863944.172331:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863944.172350:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788863944.172356:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226660736:0@lo:400:kworker.0 00000100:00100000:0.0:1788863944.172687:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788863944.172772:0:19251:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226660352 00000100:00100000:0.0:1788863944.172776:0:19251:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226660352 00000100:00080000:1.0:1788863944.172818:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863944.172835:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788863944.172844:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226660352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788863944.172899:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226660352:12345-0@lo:400:kworker.0 Request processed in 56us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863944.172906:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788863944.172931:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226660096:0@lo:400:kworker.0 00000400:00000100:0.0:1788863944.172957:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875759226660096 offset 0 length 224: 4 00000100:00100000:0.0:1788863944.172993:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863944.172999:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226660992:0@lo:400:kworker.0 00000100:00100000:0.0:1788863944.173021:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863944.173144:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226660352:0@lo:400:kworker.0 00000100:00100000:3.0:1788863944.173505:0:17062:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226660480 00000100:00100000:3.0:1788863944.173510:0:17062:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226660480 00000100:00100000:0.0:1788863944.173543:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226659968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788863944.173588:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226660608 00000100:00100000:1.0:1788863944.173593:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226660608 00000100:00100000:1.0:1788863944.173609:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226660864 00000100:00100000:1.0:1788863944.173611:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226660864 00000100:00100000:1.0:1788863944.173619:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226660736 00000100:00100000:1.0:1788863944.173621:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226660736 00000100:00100000:1.0:1788863944.173682:0:19853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226660992 00000100:00100000:1.0:1788863944.173686:0:19853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226660992 00000100:00080000:0.0:1788863944.173708:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788863944.173780:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788863944.173788:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788863944.173788:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226660736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788863944.173794:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226660992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788863944.173846:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226660736:12345-0@lo:400:kworker.0 Request processed in 58us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788863944.173851:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875759226660992:12345-0@lo:400:kworker.0 Request processed in 57us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863944.173853:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788863944.173856:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788863944.173868:0:19853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788863944.173872:0:19853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1875759226660480:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788863944.173875:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788863944.173878:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226660608:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788863944.173887:0:19853:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1788863944.173888:0:17062:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788863944.173949:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff89e66d4b9880 x1875759226660992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863944.173961:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226660992:0@lo:400:kworker.0 00010000:00080000:0.0:1788863944.173998:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff89e66d4b9c00 x1875759226660736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788863944.174008:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226660736:0@lo:400:kworker.0 00000100:00100000:3.0:1788863944.174252:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226660608:12345-0@lo:38:kworker.0 Request processed in 370us (2031us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788863944.174260:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788863944.174275:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788863944.174279:0:17062:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226660864:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788863944.174289:0:17062:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788863944.174298:0:19853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1875759226660480:12345-0@lo:38:kworker.0 Request processed in 424us (2115us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788863944.174304:0:19853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788863944.174314:0:17062:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226660864:12345-0@lo:38:kworker.0 Request processed in 34us (2065us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788863944.174319:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788863944.174396:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5425bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863944.174402:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863944.174406:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226660608:0@lo:38:kworker.0 00000100:00080000:0.0:1788863944.174417:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5448e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863944.174420:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863944.174422:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226660864:0@lo:38:kworker.0 00000100:00080000:0.0:1788863944.174430:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676192800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788863944.174433:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788863944.174435:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226660480:0@lo:38:kworker.0 00000100:00080000:1.0:1788863944.190143:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544170000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788863944.190154:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788863944.190159:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226660224:0@lo:38:kworker.0 00000100:00100000:2.0:1788863944.190430:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875759226660224:12345-0@lo:38:kworker.0 Request processed in 18125us (18286us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788863944.190452:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788863944.684457:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863944.684482:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226661120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788863944.684554:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788863944.684789:0:18571:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226661120 00000100:00100000:1.0:1788863944.684798:0:18571:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226661120 00000100:00100000:1.0:1788863944.684891:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788863944.684900:0:18571:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226661120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788863944.684934:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788863944.684988:0:18571:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226661120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863944.684996:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788863944.685061:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226661120:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788863945.003332:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863946.027405:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788863946.272208:0:20837:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788863946.303404:0:20837:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788863946.303465:0:20837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.303481:0:20837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.303489:0:20837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.303496:0:20837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.303526:0:20837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788863946.303533:0:20837:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788863946.303561:0:20837:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788863946.303566:0:20837:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788863946.303573:0:20837:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788863946.303579:0:20837:0:(import.c:65:import_set_state_nolock()) ffff89e676192800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788863946.303584:0:20837:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788863946.303586:0:20837:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788863946.303602:0:20837:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788863946.304546:0:20837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304559:0:20837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304565:0:20837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304572:0:20837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304584:0:20837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788863946.304589:0:20837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304596:0:20837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304601:0:20837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304607:0:20837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304614:0:20837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788863946.304619:0:20837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304625:0:20837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304641:0:20837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304648:0:20837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304655:0:20837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788863946.304660:0:20837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304667:0:20837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304673:0:20837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304678:0:20837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788863946.304685:0:20837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:1.0:1788863946.304688:0:20837:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788863946.304717:0:20837:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788863946.304721:0:20837:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788863946.304725:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863946.304731:0:20837:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788863946.304739:0:20837:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff89e67d2b7800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788863946.304744:0:20837:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff89e5425b8800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788863946.304749:0:20837:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff89e681bfcd40) has exports, disconnecting them 00000020:00080000:1.0:1788863946.304758:0:20837:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff89e67d2b7800), last request at 1788863944 00000020:00000080:1.0:1788863946.304766:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a223 00000100:00080000:1.0:1788863946.304797:0:20837:0:(import.c:65:import_set_state_nolock()) ffff89e67d2b1800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788863946.304850:0:20837:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e67d2b7800): rc 0 00000020:00000080:1.0:1788863946.304852:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e67d2b7800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788863946.304865:0:20837:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff89e5425b8800), last request at 1788863944 00000020:00000080:1.0:1788863946.304868:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a0c5 00000100:00080000:1.0:1788863946.304873:0:20837:0:(import.c:65:import_set_state_nolock()) ffff89e5425bb800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788863946.304879:0:20837:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e5425b8800): rc 0 00000020:00000080:1.0:1788863946.304881:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e5425b8800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788863946.304887:0:20837:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa4a9c1db3ae0 00000100:00080000:1.0:1788863946.304905:0:20837:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788863946.304909:0:20837:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788863946.305759:0:20837:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788863946.305766:0:20837:0:(import.c:65:import_set_state_nolock()) ffff89e544170000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1788863946.305959:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788863946.305969:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.305980:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b400 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863946.305984:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.305994:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863946.306001:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863946.306007:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788863946.306010:0:17048:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788863946.306013:0:17048:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788863946.306052:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306058:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863946.306119:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306127:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e64259b400/0xf569beb9d4b69fe5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69fec expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306152:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788863946.306155:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306160:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f400 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863946.306163:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306170:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863946.306176:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863946.306181:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788863946.306183:0:17048:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1788863946.306185:0:17048:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1788863946.306199:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306204:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863946.306210:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306217:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e542a3f400/0xf569beb9d4b69f44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69f4b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306224:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788863946.306228:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306239:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e650922a00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863946.306242:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306248:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863946.306254:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863946.306259:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788863946.306261:0:17048:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788863946.306263:0:17048:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788863946.306275:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306281:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863946.306297:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306304:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e650922a00/0xf569beb9d4b6a231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6a238 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306317:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788863946.306321:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306327:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fc00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863946.306331:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306344:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863946.306351:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863946.306357:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788863946.306359:0:17048:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788863946.306361:0:17048:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788863946.306373:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306379:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863946.306386:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306409:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e542a3fc00/0xf569beb9d4b6a3dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b6a3e3 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306421:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788863946.306424:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306430:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e800 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863946.306433:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306440:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863946.306457:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863946.306463:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788863946.306466:0:17048:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788863946.306467:0:17048:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788863946.306480:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306486:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788863946.306490:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306497:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e542a3e800/0xf569beb9d4b69f36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf569beb9d4b69f3d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863946.306509:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863946.306510:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863946.306512:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863946.306599:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226661376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863946.306668:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863946.306727:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788863946.306734:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226661248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863946.306756:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863946.306774:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226661760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863946.306811:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863946.306838:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226661504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863946.306873:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863946.306892:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788863946.306898:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226661632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788863946.306917:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788863946.306948:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226661376 00000100:00100000:2.0:1788863946.306955:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226661376 00000100:00100000:2.0:1788863946.306985:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226661248 00000100:00100000:2.0:1788863946.306988:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226661248 00000100:00100000:2.0:1788863946.306996:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226661760 00000100:00100000:2.0:1788863946.306999:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226661760 00000100:00100000:2.0:1788863946.307007:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226661504 00000100:00100000:2.0:1788863946.307008:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226661504 00000100:00100000:2.0:1788863946.307016:0:17045:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226661632 00000100:00100000:2.0:1788863946.307018:0:17045:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226661632 00000100:00100000:2.0:1788863946.307031:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788863946.307038:0:17045:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1875759226661376:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788863946.307044:0:17045:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788863946 with bad export cookie 17683875117193928208 00010000:00010000:0.0:1788863946.307874:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788863946.307997:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863946.308006:0:17046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1875759226661248:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788863946.308024:0:17046:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788863946 with bad export cookie 17683875117193928208 00000100:00100000:0.0:1788863946.308105:0:17046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1875759226661248:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (1346us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788863946.308112:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788863946.308138:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863946.308143:0:17046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6586ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1875759226661760:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788863946.308147:0:17046:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788863946 with bad export cookie 17683875117193928208 00000100:00100000:0.0:1788863946.308173:0:17046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6586ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1875759226661760:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (1362us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788863946.308179:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788863946.308192:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788863946.308196:0:17046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3640:x1875759226661504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788863946.308200:0:17046:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788863946 with bad export cookie 17683875117193928208 00000100:00100000:0.0:1788863946.308229:0:17046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3640:x1875759226661504:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (1355us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788863946.308235:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788863946.308247:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788863946.308252:0:17046:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3640:x1875759226661632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788863946.308255:0:17046:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788863946 with bad export cookie 17683875117193928208 00000100:00100000:0.0:1788863946.308279:0:17046:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3640:x1875759226661632:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (1360us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788863946.308285:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000020:00000080:3.0:1788863946.308704:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67d2b7800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788863946.308749:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425b8800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788863946.308770:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67d2b1800 for lustre-MDT0001 00000020:00000080:3.0:1788863946.308775:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5425bb800 for lustre-MDT0001 00000100:00080000:3.0:1788863946.308841:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.135@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788863946.308846:0:3643:0:(import.c:65:import_set_state_nolock()) ffff89e5448c5800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788863946.308850:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.135@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788863946.312059:0:20837:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788863946.312067:0:20837:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788863946.312184:0:20837:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788863946.313947:0:20837:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788863946.313983:0:20837:0:(import.c:65:import_set_state_nolock()) ffff89e544175800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788863946.314012:0:20837:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788863946.314016:0:20837:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788863946.314028:0:20837:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788863946.314446:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226661888:0@lo:9:umount.0 00000100:00100000:1.0:1788863946.314523:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788863946.314587:0:20837:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788863946.314600:0:20837:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788863946.314618:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226662016:0@lo:9:umount.0 00000100:00100000:1.0:1788863946.314655:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788863946.314716:0:20837:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff89e681bfcd40) has no exports 00000100:00100000:1.0:1788863946.317868:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226661888 00000100:00100000:1.0:1788863946.317888:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226661888 00000100:00100000:1.0:1788863946.318050:0:18569:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226662016 00000100:00100000:1.0:1788863946.318055:0:18569:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226662016 00000100:00100000:1.0:1788863946.318102:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788863946.318113:0:18569:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875759226661888:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788863946.318145:0:18569:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a0ef 00000100:00080000:1.0:1788863946.318155:0:18569:0:(import.c:65:import_set_state_nolock()) ffff89e5427bc800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788863946.318203:0:18569:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00080000:0.0:1788863946.319172:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788863946.319178:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788863946.319197:0:19251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788863946.319209:0:19251:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875759226662016:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788863946.319246:0:19251:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a254 00000100:00080000:0.0:1788863946.319254:0:19251:0:(import.c:65:import_set_state_nolock()) ffff89e67d2b2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788863946.319287:0:19251:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788863946.319839:0:18569:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3639:x1875759226661888:12345-0@lo:9:umount.0 Request processed in 1725us (5312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788863946.319849:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788863946.320350:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.135@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1788863946.320797:0:19251:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3639:x1875759226662016:12345-0@lo:9:umount.0 Request processed in 1578us (6126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788863946.320806:0:19251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788863946.320836:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788863946.320884:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67b6ae000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788863946.320899:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788863946.320901:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788863946.320905:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226662016:0@lo:9:umount.0 00000100:00080000:0.0:1788863946.321374:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544175800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788863946.321385:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788863946.321387:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788863946.321406:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544209180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226661888:0@lo:9:umount.0 00010000:00010000:0.0:1788863946.321462:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788863946.349256:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.135@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788863946.349262:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788863946.349273:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e6808e9880 x1875759226660096/t0(0) o400->MGC192.168.204.135@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788863960 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863946.349307:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e68086f100 x1875759226661376/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788863962 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863946.349316:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e68086d500 x1875759226661248/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788863962 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863946.349343:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e68086fb80 x1875759226661760/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788863962 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863946.349351:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e68086df80 x1875759226661504/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788863962 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863946.349600:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e68086c700 x1875759226661632/t0(0) o103->MGC192.168.204.135@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788863962 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788863946.349609:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788863946.349613:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788863946.349614:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788863946.351802:0:3640:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89e5448c5800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788863946.351843:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226661504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788863946.351880:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dea3065e-0e63-4370-a87c-9d4f07265d5e:3640:1875759226661632:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788863946.358477:0:3643:0:(import.c:65:import_set_state_nolock()) ffff89e5448c5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788863946.358495:0:3643:0:(import.c:545:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 490 00000100:00080000:3.0:1788863946.358517:0:3643:0:(import.c:666:import_select_connection()) MGC192.168.204.135@tcp: import ffff89e5448c5800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788863946.358590:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543927b80 x1875759226662144/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863946.358664:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dea3065e-0e63-4370-a87c-9d4f07265d5e:3639:1875759226662144:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1788863946.358724:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875759226662144 offset 0 length 520: 4 00000100:00100000:3.0:1788863946.358894:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226661760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863946.358902:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226661376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863946.358927:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dea3065e-0e63-4370-a87c-9d4f07265d5e:3643:1875759226661248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788863946.358983:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dea3065e-0e63-4370-a87c-9d4f07265d5e:3641:1875759226660096:0@lo:400:kworker.0 00000400:00000100:2.0:1788863946.362235:0:17045:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875759226661376 offset 224 length 224: 4 00000100:00100000:2.0:1788863946.362259:0:17045:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1875759226661376:12345-0@lo:103:ldlm_bl.0 Request processed in 55219us (55589us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788863946.362270:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00080000:2.0:1788863946.378854:0:20837:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff89e681bfcd40) has no exports 00000020:01000000:3.0:1788863946.440292:0:20837:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e681ad5b40 - data ffff89e671f1c0d8/ffff89e542555c00 00000020:01000000:3.0:1788863946.440449:0:20837:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e543adfd80 - data ffff89e64a643438/ffff89e67b7aa000 00000001:00000004:3.0:1788863946.459858:0:20837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1788863946.506266:0:20837:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788863946.506277:0:20837:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788863946.506284:0:20837:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788863946.510567:0:20837:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788863946.510576:0:20837:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788863946.510706:0:20837:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788863946.510709:0:20837:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788863946.511833:0:17801:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788863946.511839:0:17801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1788863946.511852:0:17801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788863946.512879:0:20837:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788863946.512885:0:20837:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788863946.512897:0:20837:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788863946.512899:0:20837:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788863946.520751:0:17803:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788863946.520761:0:17803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788863946.520787:0:17803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788863946.538146:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69f59 00000020:00000080:0.0:1788863946.538158:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e650810800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788863946.538313:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e650810800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788863946.539389:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69f6e 00000020:00000080:1.0:1788863946.539398:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e67c4d9800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788863946.539414:0:20837:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788863946.539419:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863946.539429:0:20837:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788863946.539443:0:20837:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff89e681bf99c0) has no exports 00000004:01000000:1.0:1788863946.539610:0:20837:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788863946.539617:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69fc2 00000020:00000080:1.0:1788863946.539622:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e661d25000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788863946.539626:0:20837:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788863946.539630:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863946.539633:0:20837:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788863946.539636:0:20837:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff89e67b6c19c0) has no exports 00000020:00000080:1.0:1788863946.539641:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69fbb 00000020:00000080:1.0:1788863946.539644:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e67b6ae800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788863946.539980:0:20837:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788863946.539985:0:20837:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788863946.539989:0:20837:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788863946.539994:0:20837:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788863946.539996:0:20837:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788863946.540029:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863946.540035:0:20837:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788863946.540047:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69fad 00000020:00000080:1.0:1788863946.540808:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e67b6ab000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788863946.540817:0:20837:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788863946.540822:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863946.540827:0:20837:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788863946.540830:0:20837:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff89e66c6499c0) has no exports 00000020:00000080:1.0:1788863946.540836:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69fa6 00000020:00000080:1.0:1788863946.540840:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e544176800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788863946.541179:0:20837:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788863946.541183:0:20837:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788863946.541186:0:20837:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788863946.541190:0:20837:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788863946.541192:0:20837:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788863946.541335:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67c4d9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788863946.541351:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e661d25000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788863946.541355:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67b6ae800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788863946.541361:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67b6ae000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788863946.541366:0:13187:0:(genops.c:885:class_export_put()) final put ffff89e67b6ac800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788863946.541368:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67b6ac800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788863946.541372:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788863946.541446:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67b6ab000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788863946.541451:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e544176800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788863946.542252:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863946.542261:0:20837:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788863946.542294:0:20837:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788863946.542301:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69f91 00000020:00000080:1.0:1788863946.542307:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e655c60800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788863946.544587:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e544175800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788863946.544604:0:13187:0:(genops.c:885:class_export_put()) final put ffff89e655c66800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788863946.544607:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e655c66800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788863946.544616:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788863946.550196:0:20837:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788863946.550217:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863946.550229:0:20837:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788863946.550235:0:20837:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff89e681bf8000) has no exports 00000020:00000080:1.0:1788863946.550247:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69f8a 00000020:00000080:1.0:1788863946.550256:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e544174000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788863946.554417:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e655c60800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788863946.557102:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e544174000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788863946.561551:0:20837:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788863946.561560:0:20837:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788863946.561646:0:20837:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788863946.561654:0:20837:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788863946.561754:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863946.561775:0:20837:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788863946.561822:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863946.561826:0:20837:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788863946.561832:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e650816800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788863946.561836:0:20837:0:(genops.c:844:class_export_destroy()) destroying export ffff89e650816800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788863946.561870:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e544170000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788863946.561876:0:13187:0:(genops.c:885:class_export_put()) final put ffff89e544177000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788863946.561878:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e544177000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788863946.561886:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788863946.562385:0:20837:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788863946.562631:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69f75 00000020:00000080:0.0:1788863946.562639:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e67c4d8000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788863946.562653:0:20837:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788863946.562657:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863946.562662:0:20837:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788863946.562774:0:20837:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff89e681bfb380) has no exports 00000020:00000080:0.0:1788863946.562804:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863946.562810:0:20837:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788863946.562814:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69f7c 00000020:00000080:0.0:1788863946.562818:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e67c4db800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788863946.562949:0:20837:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e5425c9800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788863946.562953:0:20837:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e5425c9800 2 00000020:01000004:0.0:1788863946.562956:0:20837:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e5425c9800 from lustre-MDT0001 00000020:00000080:0.0:1788863946.562973:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863946.562976:0:20837:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788863946.562979:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e650810000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788863946.562981:0:20837:0:(genops.c:844:class_export_destroy()) destroying export ffff89e650810000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788863946.562988:0:20837:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788863946.563017:0:20837:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788863946.563020:0:20837:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788863946.563023:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863946.563026:0:20837:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788863946.563032:0:20837:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff89e676194000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788863946.563037:0:20837:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff89e6763c4d40) has exports, disconnecting them 00000020:00080000:0.0:1788863946.563042:0:20837:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff89e676194000), last request at 1788863837 00000020:00000080:0.0:1788863946.563051:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69ffa 00000020:00080000:0.0:1788863946.563064:0:20837:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e676194000): rc 0 00000020:00000080:0.0:1788863946.563068:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e676194000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788863946.563366:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67c4d8000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788863946.563377:0:13187:0:(genops.c:885:class_export_put()) final put ffff89e650811000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788863946.563379:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e650811000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788863946.563383:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788863946.563504:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67c4db800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788863946.563509:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e676194000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788863946.584156:0:20837:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788863946.584164:0:20837:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788863946.584169:0:20837:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788863946.584176:0:20837:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788863946.584223:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e676192800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788863946.584433:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863946.584443:0:20837:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788863946.584449:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e676194800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788863946.584453:0:20837:0:(genops.c:844:class_export_destroy()) destroying export ffff89e676194800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788863946.584458:0:20837:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788863946.584530:0:20837:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e5425c9800 1 00000020:00000080:3.0:1788863946.584536:0:20837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69f21 00000020:00000080:3.0:1788863946.584542:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e5448c2000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788863946.584550:0:20837:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788863946.584557:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5448c2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788863946.584566:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863946.584571:0:20837:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788863946.584575:0:20837:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff89e66c648000) has no exports 00000020:00000080:1.0:1788863946.794265:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863946.794280:0:20837:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788863946.794286:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e5425ca800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788863946.794291:0:20837:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425ca800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788863946.794303:0:20837:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788863946.794430:0:20837:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89e5425cf800 00000020:01000000:1.0:1788863946.794452:0:20837:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788863946.794457:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863946.794461:0:20837:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788863946.794466:0:20837:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff89e543a18000) has no exports 00000100:00100000:2.0:1788863946.794856:0:19853:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff89e65d9b2e00:19853] 3 exiting: rc = 0 00000100:00100000:2.0:1788863946.794991:0:17060:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff89e65983fe00:17060] 0 exiting: rc = 1 00000100:00100000:2.0:1788863946.795060:0:17062:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff89e651c6c800:17062] 2 exiting: rc = 0 00000100:00100000:2.0:1788863946.795165:0:20258:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff89e67b63d800:20258] 4 exiting: rc = 0 00000100:00100000:2.0:1788863946.795240:0:17061:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff89e651c6cc00:17061] 1 exiting: rc = 0 00000100:00100000:1.0:1788863946.795402:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795408:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795414:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795421:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795427:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795432:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795438:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795445:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795450:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795459:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795464:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795469:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795475:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795481:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795501:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795507:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795513:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795518:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795523:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795528:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795534:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795540:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795545:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795551:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795556:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795562:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795567:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795573:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795579:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795585:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795590:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.795595:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798561:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798578:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798584:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798590:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798595:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798603:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798609:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798616:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798621:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798627:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798632:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798637:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798642:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798647:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798652:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798822:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.798831:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799550:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799557:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799563:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799570:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799575:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799581:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799586:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799592:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799613:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799620:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799626:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799631:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799637:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799642:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.799649:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863946.811985:0:17064:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff89e6762ea000:17064] 1 exiting: rc = 0 00000100:00100000:2.0:1788863946.812324:0:17063:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff89e6762ea400:17063] 0 exiting: rc = 1 00000100:00100000:1.0:1788863946.812737:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812750:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812756:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812763:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812769:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812784:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812791:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812796:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812801:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812806:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812812:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812817:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812823:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812831:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812836:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812842:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812847:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812853:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812858:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812862:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812887:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812892:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812897:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812902:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812907:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812913:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812918:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812923:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812928:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812933:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812939:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812944:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812949:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812954:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812960:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812965:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812970:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812975:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812980:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812985:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812991:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.812995:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813001:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813006:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813011:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813015:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813020:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813025:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813029:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813039:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813044:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813048:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813053:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813059:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813063:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813325:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813457:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813464:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813470:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813477:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813482:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813488:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813493:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.813498:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863946.815507:0:18128:0:(service.c:3206:ptlrpc_main()) mdt_out00_002: service thread [ffff89e67b63fc00:18128] 2 exiting: rc = 0 00000100:00100000:2.0:1788863946.815933:0:17065:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff89e67565d400:17065] 0 exiting: rc = 1 00000100:00100000:1.0:1788863946.816245:0:17066:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff89e67565c200:17066] 1 exiting: rc = 0 00000100:00100000:3.0:1788863946.816902:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.816913:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.816918:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.816924:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.816930:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.816935:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.816942:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.816959:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.816966:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.816984:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.816991:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.816997:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817015:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817021:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817026:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817032:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817044:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817050:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817056:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817067:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817417:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817428:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817435:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817441:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817464:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817472:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817478:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817484:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817490:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817497:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817502:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817509:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817515:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817521:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817526:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817532:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817552:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817559:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817565:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817571:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817577:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817583:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817610:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817616:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817622:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817628:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817633:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817639:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817799:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817811:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817818:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817823:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817831:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817837:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817843:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817850:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817856:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817861:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817867:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817873:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817894:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817902:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817908:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.817913:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.830851:0:17067:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff89e67565c400:17067] 0 exiting: rc = 1 00000100:00100000:1.0:1788863946.831067:0:17068:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff89e67565c800:17068] 1 exiting: rc = 0 00000100:00100000:3.0:1788863946.831294:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831302:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831307:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831312:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831317:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831323:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831329:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831344:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831349:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831355:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831360:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831365:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831370:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831388:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831393:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831398:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831403:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831407:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831412:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831417:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831422:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831426:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831431:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831435:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831441:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831445:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831451:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831456:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831461:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831466:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831471:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831476:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831481:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831486:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831492:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831497:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831502:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831507:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831512:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831517:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831521:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831527:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831532:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831537:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831542:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831548:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831553:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831559:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831573:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831578:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831583:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831588:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831592:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831762:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831771:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831785:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831790:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831795:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831800:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831804:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831809:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831814:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831819:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.831824:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863946.832232:0:17069:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff89e67565dc00:17069] 0 exiting: rc = 1 00000100:00100000:1.0:1788863946.832382:0:17070:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff89e67565da00:17070] 1 exiting: rc = 0 00000100:00100000:3.0:1788863946.832788:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832794:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832799:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832804:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832809:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832813:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832818:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832823:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832828:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832832:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832838:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832842:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832848:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832853:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832858:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832863:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832868:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832873:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832879:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832894:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832899:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832904:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832909:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832914:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832920:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832924:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832930:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832935:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832939:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832944:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832949:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832954:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832958:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832963:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832969:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832974:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832978:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832983:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832988:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832992:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.832997:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833002:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833007:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833012:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833017:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833022:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833026:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833031:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833036:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833040:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833045:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833049:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833054:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833060:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833071:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833478:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833485:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833491:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833495:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833501:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833507:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833511:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833516:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.833521:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.833968:0:17071:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff89e645221200:17071] 0 exiting: rc = 1 00000100:00100000:2.0:1788863946.834427:0:17072:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff89e645221a00:17072] 1 exiting: rc = 0 00000100:00100000:3.0:1788863946.834550:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834557:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834562:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834567:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834572:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834576:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834581:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834586:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834591:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834596:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834611:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834617:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834622:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834627:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834632:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834637:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834642:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834647:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834652:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834657:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834671:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834676:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834682:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834687:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834692:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834710:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834715:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834720:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834724:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834729:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834735:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834740:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834745:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834750:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834755:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834761:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834766:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834771:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834787:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834792:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834797:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834802:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834807:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834811:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834815:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834820:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834824:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834829:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834834:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834839:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834843:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834848:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834852:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834857:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834862:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834867:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834872:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834877:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834883:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834888:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834900:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834905:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834911:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.834917:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863946.835750:0:17073:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff89e651ff0000:17073] 0 exiting: rc = 1 00000100:00100000:1.0:1788863946.835945:0:17075:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff89e645221000:17075] 2 exiting: rc = 0 00000100:00100000:0.0:1788863946.838058:0:17074:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff89e645220000:17074] 1 exiting: rc = 0 00000100:00100000:3.0:1788863946.838307:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838316:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838331:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838339:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838345:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838350:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838356:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838362:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838368:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838374:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838380:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838387:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838393:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838398:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838403:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838408:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838415:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838420:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838427:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838451:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838459:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838465:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838471:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838477:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838484:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838489:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838496:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838501:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838507:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838513:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838518:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838535:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838541:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838546:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838551:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838557:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838562:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838567:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838572:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838578:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838582:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838588:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838594:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838613:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838620:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838625:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838630:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838635:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838640:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838645:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838650:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838657:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838787:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838795:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838800:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838805:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838810:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838815:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838821:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838827:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838832:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838838:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838844:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863946.838850:0:20837:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788863946.847064:0:20837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863946.847257:0:20837:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788863946.847278:0:20837:0:(genops.c:885:class_export_put()) final put ffff89e67f897000/MDS_uuid 00000020:00000080:3.0:1788863946.847282:0:20837:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67f897000/MDS_uuid for MDS 00000020:01000000:3.0:1788863946.847292:0:20837:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788863946.847434:0:20837:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788863947.051883:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863948.075825:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863949.099285:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788863949.291230:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) dea3065e-0e63-4370-a87c-9d4f07265d5e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863949.291246:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) dea3065e-0e63-4370-a87c-9d4f07265d5e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863949.291250:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863949.291254:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788863949.291261:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e5425bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863949.291272:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 611 00000100:00080000:0.0:1788863949.291279:0:13187:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788863949.291307:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e5425bf000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863949.291362:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438dce00 x1875759226662272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788863949.291416:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863949.291420:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788863949.291422:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e5448e6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788863949.291426:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 611 00000100:00080000:0.0:1788863949.291429:0:13187:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788863949.291435:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e5448e6000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788863949.291449:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438dc700 x1875759226662528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788863949.291506:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788863949.291520:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226662656:0@lo:400:kworker.0 00000100:00100000:0.0:1788863949.291520:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226662400:0@lo:400:kworker.0 00000100:00100000:3.0:1788863949.291893:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226662272:0@lo:38:kworker.0 00000400:00000100:1.0:1788863949.293873:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226662656 offset 0 length 224: 4 00000400:00000100:3.0:1788863949.297815:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226662272 offset 0 length 520: 4 00000400:00000100:1.0:1788863949.297868:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226662400 offset 0 length 224: 4 00000100:00100000:3.0:1788863949.297871:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226662528:0@lo:38:kworker.0 00000400:00000100:3.0:1788863949.297902:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226662528 offset 0 length 520: 4 00010000:00010000:2.0:1788863950.123198:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863951.163488:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788863951.339303:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) dea3065e-0e63-4370-a87c-9d4f07265d5e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863951.339313:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) dea3065e-0e63-4370-a87c-9d4f07265d5e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788863951.339316:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863951.339319:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788863951.339747:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788863951.339767:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788863951.339771:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788863951.339828:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226662912:0@lo:400:kworker.0 00000400:00000100:0.0:1788863951.339884:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226662912 offset 0 length 224: 4 00000100:00100000:1.0:1788863951.343945:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226662784:0@lo:400:kworker.0 00000400:00000100:1.0:1788863951.344010:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226662784 offset 0 length 224: 4 00000020:01000004:2.0:1788863951.542287:0:21037:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788863951.573403:0:21037:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788863951.573702:0:21037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863951.573718:0:21037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863951.573726:0:21037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863951.573734:0:21037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863951.573771:0:21037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788863951.573777:0:21037:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788863951.573808:0:21037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788863951.573823:0:21037:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438dce00 x1875759226662272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788863974 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863951.573906:0:21037:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788863951.573913:0:21037:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788863951.573921:0:21037:0:(import.c:65:import_set_state_nolock()) ffff89e5425bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788863951.573927:0:21037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788863951.573932:0:21037:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438dce00 x1875759226662272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788863974 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788863951.573941:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863951.573949:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863951.573957:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863951.573961:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863951.573971:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863951.573979:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863951.574006:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788863951.574009:0:17048:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788863951.574011:0:17048:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788863951.574025:0:17048:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e5448c5800 00010000:00010000:0.0:1788863951.574030:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863951.574037:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e542a3e000/0xf569beb9d4b6a094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b6a09b expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863951.574051:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863951.574053:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863951.574055:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863951.575308:0:21037:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788863951.575401:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226662272:0@lo:38:kworker.0 00000100:00100000:2.0:1788863951.577056:0:21037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788863951.577978:0:21037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788863951.577993:0:21037:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438dfb80 x1875759226662400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863965 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863951.578014:0:21037:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438dd880 x1875759226662784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863967 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863951.578038:0:21037:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788863951.578358:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226662400:0@lo:400:kworker.0 00000100:00100000:1.0:1788863951.578775:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226662784:0@lo:400:kworker.0 00000100:00080000:2.0:1788863951.582014:0:21037:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788863951.582055:0:21037:0:(import.c:65:import_set_state_nolock()) ffff89e676190800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788863951.582144:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875759226663040:0@lo:39:umount.0 00000400:00000100:0.0:1788863951.582201:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226663040 offset 0 length 224: 4 00000001:00100000:0.0:1788863951.853271:0:18564:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788863951.853282:0:18564:0:(genops.c:885:class_export_put()) final put ffff89e5427bb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788863951.854433:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5427bb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788863951.854507:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5427bc800 for lustre-OST0000 00000001:00100000:2.0:1788863951.855571:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788863951.855580:0:19382:0:(genops.c:885:class_export_put()) final put ffff89e67d2b3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788863951.855647:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67d2b3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788863951.855709:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e67d2b2800 for lustre-OST0001 00010000:00010000:0.0:1788863952.171383:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863953.195606:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863954.219407:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788863954.348377:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) dea3065e-0e63-4370-a87c-9d4f07265d5e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863954.348390:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) dea3065e-0e63-4370-a87c-9d4f07265d5e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863954.348394:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863954.348422:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788863954.348554:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226663168:0@lo:400:kworker.0 00000400:00000100:0.0:1788863954.348636:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226663168 offset 0 length 224: 4 00010000:00010000:0.0:1788863955.243549:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863956.268372:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863956.715273:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863946/real 1788863946] req@ffff89e543927b80 x1875759226662144/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788863956 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863956.715323:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e543927b80 x1875759226662144/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788863956 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788863956.715350:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e5448c5800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788863956.715380:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788863956.715386:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dea3065e-0e63-4370-a87c-9d4f07265d5e:3639:1875759226662144:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1788863956.715916:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) dea3065e-0e63-4370-a87c-9d4f07265d5e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788863956.715923:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788863956.715926:0:38:0:(import.c:65:import_set_state_nolock()) ffff89e5448c5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788863956.715933:0:38:0:(import.c:545:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 613 00000100:00080000:2.0:1788863956.715941:0:38:0:(import.c:630:import_select_connection()) MGC192.168.204.135@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788863956.715955:0:38:0:(import.c:666:import_select_connection()) MGC192.168.204.135@tcp: import ffff89e5448c5800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788863956.716018:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67af57480 x1875759226663296/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788863956.716051:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788863956.716056:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788863956.716292:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788863956.716333:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226663424:0@lo:400:kworker.0 00000400:00000100:0.0:1788863956.716414:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226663424 offset 0 length 224: 4 00000100:00100000:1.0:1788863956.716557:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dea3065e-0e63-4370-a87c-9d4f07265d5e:3639:1875759226663296:0@lo:250:kworker.0 00000400:00000100:1.0:1788863956.716594:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875759226663296 offset 0 length 520: 4 00010000:00010000:0.0:1788863957.292188:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863958.317316:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863959.339347:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863960.363474:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863961.387675:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788863961.835996:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863951/real 1788863951] req@ffff89e67af54380 x1875759226663040/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788863961 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863961.836043:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e67af54380 x1875759226663040/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788863961 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788863961.836070:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676190800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788863961.836127:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875759226663040:0@lo:39:umount.0 00000100:00080000:2.0:1788863961.837003:0:21037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788863961.837011:0:21037:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788863961.837019:0:21037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788863961.838582:0:21037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863961.838605:0:21037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863961.838633:0:21037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863961.838639:0:21037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863961.838676:0:21037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788863961.838684:0:21037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863961.838691:0:21037:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863961.838698:0:21037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863961.838704:0:21037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863961.838734:0:21037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788863961.838740:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:2.0:1788863961.838741:0:21037:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1788863961.838753:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863961.838763:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863961.838768:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863961.838779:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788863961.838781:0:21037:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788863961.838789:0:21037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 10000000:00010000:0.0:1788863961.838792:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788863961.838797:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:01000000:0.0:1788863961.838802:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00000080:2.0:1788863961.838806:0:21037:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 10000000:01000000:0.0:1788863961.838807:0:17049:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788863961.838813:0:17049:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:00080000:2.0:1788863961.838814:0:21037:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff89e67b6c3380) has no exports 00010000:00010000:0.0:1788863961.838834:0:17049:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e5448c5800 00010000:00010000:0.0:1788863961.838841:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788863961.838848:0:21037:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff89e67b6c3380) has no exports 00010000:00010000:0.0:1788863961.838850:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e64259b200/0xf569beb9d4b6a06a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b6a071 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863961.838890:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863961.838894:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863961.838900:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863961.838904:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863961.838911:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863961.838918:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863961.838938:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788863961.838940:0:17049:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788863961.838942:0:17049:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788863961.838950:0:17049:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e5448c5800 00010000:00010000:0.0:1788863961.838953:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863961.838960:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d99000/0xf569beb9d4b6a3ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b6a3d5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863961.838970:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863961.838972:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863961.838974:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863961.840440:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788863961.842305:0:21037:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e6761ab000 - data ffff89e671c82af8/ffff89e680877400 00000020:01000000:2.0:1788863961.843063:0:21037:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e543adfba0 - data ffff89e671e6faf8/ffff89e67b65c800 00100000:10000000:2.0:1788863961.855208:0:21037:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788863961.880508:0:21037:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a07f 00000020:00000080:3.0:1788863961.880521:0:21037:0:(genops.c:885:class_export_put()) final put ffff89e543ac7800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788863961.880552:0:21037:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e67b71c000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788863961.880557:0:21037:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e67b71c000 2 00000020:01000004:3.0:1788863961.880560:0:21037:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e67b71c000 from lustre-OST0000 00000020:00000080:3.0:1788863961.880586:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863961.880597:0:21037:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788863961.880600:0:21037:0:(genops.c:885:class_export_put()) final put ffff89e543ac4000/lustre-OST0000_UUID 00000020:00000080:3.0:1788863961.880603:0:21037:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543ac4000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788863961.880609:0:21037:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788863961.880655:0:21037:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788863961.880659:0:21037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788863961.880664:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863961.880669:0:21037:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788863961.880676:0:21037:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff89e5425b9000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788863961.880681:0:21037:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff89e67b6c0000) has exports, disconnecting them 00000020:00080000:3.0:1788863961.880685:0:21037:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff89e5425b9000), last request at 1788863854 00000020:00000080:3.0:1788863961.880699:0:21037:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a0a9 00000020:00080000:3.0:1788863961.880710:0:21037:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e5425b9000): rc 0 00000020:00000080:3.0:1788863961.880716:0:21037:0:(genops.c:885:class_export_put()) final put ffff89e5425b9000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788863961.881446:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543ac7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788863961.881462:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425b9000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788863961.887795:0:21037:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788863961.887808:0:21037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788863961.887831:0:21037:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788863961.887842:0:21037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788863961.888105:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863961.888120:0:21037:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788863961.888130:0:21037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788863961.888136:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863961.888142:0:21037:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788863961.888155:0:21037:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff89e67b778000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788863961.888163:0:21037:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff89e6763c19c0) has exports, disconnecting them 00000020:00080000:0.0:1788863961.888169:0:21037:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff89e67b778000), last request at 1788863854 00000020:00000080:0.0:1788863961.888175:0:21037:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a0be 00000020:00000080:1.0:1788863961.889715:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5425bf000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788863961.889732:0:13187:0:(genops.c:885:class_export_put()) final put ffff89e543ac0800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788863961.889736:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e543ac0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788863961.889744:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00080000:0.0:1788863961.889946:0:21037:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e67b778000): rc 0 00000020:00000080:0.0:1788863961.889966:0:21037:0:(genops.c:885:class_export_put()) final put ffff89e67b778000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788863961.890020:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67b778000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788863961.891738:0:21037:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788863961.891749:0:21037:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788863961.891756:0:21037:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788863961.891766:0:21037:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788863961.892813:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863961.892830:0:21037:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788863961.892838:0:21037:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e67b71c000 1 00000020:00000080:0.0:1788863961.892847:0:21037:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a05c 00000020:00000080:0.0:1788863961.892858:0:21037:0:(genops.c:885:class_export_put()) final put ffff89e650816000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788863961.892865:0:21037:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788863961.892875:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863961.892880:0:21037:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788863961.892884:0:21037:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff89e66c64cd40) has no exports 00000020:00000080:0.0:1788863961.901032:0:13187:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e676190800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788863961.901057:0:13187:0:(genops.c:885:class_export_put()) final put ffff89e67b77d000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788863961.901061:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67b77d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788863961.901124:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788863961.901227:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff89e650816000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788863961.950502:0:21037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788863961.950522:0:21037:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788863961.950530:0:21037:0:(genops.c:885:class_export_put()) final put ffff89e67b718000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788863961.950536:0:21037:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67b718000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788863961.950550:0:21037:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788863961.950673:0:21037:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89e67b719000 00000020:02000400:3.0:1788863961.950743:0:21037:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:2.0:1788863962.091203:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) dea3065e-0e63-4370-a87c-9d4f07265d5e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788863962.091218:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) dea3065e-0e63-4370-a87c-9d4f07265d5e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788863962.091221:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788863962.091225:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788863962.091356:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788863962.091388:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226663552:0@lo:400:kworker.0 00000400:00000100:3.0:1788863962.091455:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226663552 offset 0 length 224: 4 00010000:00010000:1.0:1788863962.412649:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788863963.436479:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863964.469559:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788863965.166176:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788863949/real 1788863949] req@ffff89e5438df480 x1875759226662656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788863965 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863965.208179:0:3640:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff89e5438df480 x1875759226662656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788863965 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788863965.208196:0:3640:0:(import.c:65:import_set_state_nolock()) ffff89e541eb6800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788863965.208201:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788863965.231759:0:3640:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1788863965.232258:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) dea3065e-0e63-4370-a87c-9d4f07265d5e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863965.232267:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) dea3065e-0e63-4370-a87c-9d4f07265d5e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863965.232270:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863965.232274:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788863965.232276:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788863965.232280:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788863965.232284:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e541eb6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788863965.232295:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 539 00000100:00080000:1.0:1788863965.232327:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89e541eb6800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788863965.232395:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e54420a680 x1875759226663680/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788863965.232472:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226662656:0@lo:400:kworker.0 00000100:00100000:3.0:1788863965.232655:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875759226663680:0@lo:38:kworker.0 00000400:00000100:3.0:1788863965.232726:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875759226663680 offset 0 length 520: 4 00010000:00010000:3.0:1788863965.484255:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788863966.058613:0:21240:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788863966.065272:0:21240:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788863966.065376:0:21240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863966.065416:0:21240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863966.065423:0:21240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863966.065430:0:21240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863966.065452:0:21240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788863966.065458:0:21240:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788863966.065487:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788863966.065499:0:21240:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438dc700 x1875759226662528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788863974 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863966.065526:0:21240:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788863966.065533:0:21240:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788863966.065540:0:21240:0:(import.c:65:import_set_state_nolock()) ffff89e5448e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788863966.065546:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788863966.065553:0:21240:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438dc700 x1875759226662528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788863974 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863966.065563:0:21240:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:0.0:1788863966.065565:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788863966.065566:0:21240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00010000:00010000:0.0:1788863966.065575:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863966.065585:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863966.065590:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863966.065599:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863966.065607:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863966.065613:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788863966.065615:0:17049:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788863966.065618:0:17049:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788863966.065633:0:17049:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e5448c5800 00010000:00010000:0.0:1788863966.065638:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863966.065645:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e542a3f200/0xf569beb9d4b6a1f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b6a1f9 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863966.065657:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863966.065659:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863966.065661:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788863966.065788:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226662528:0@lo:38:kworker.0 00000100:00080000:3.0:1788863966.067334:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788863966.067349:0:21240:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e5438dca80 x1875759226662912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863967 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863966.067376:0:21240:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e54420b800 x1875759226663168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863970 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863966.067419:0:21240:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e67af55500 x1875759226663424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863972 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788863966.067431:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226662912:0@lo:400:kworker.0 00000100:00100000:3.0:1788863966.067436:0:21240:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e67af55f80 x1875759226663552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863978 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863966.067451:0:21240:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e54420a680 x1875759226663680/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788863975 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788863966.067499:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226663168:0@lo:400:kworker.0 00000100:00100000:3.0:1788863966.067527:0:21240:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788863966.067533:0:21240:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788863966.067577:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875759226663552:0@lo:400:kworker.0 00000100:00080000:2.0:1788863966.067608:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e541eb6800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788863966.067614:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1788863966.067617:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875759226663680:0@lo:38:kworker.0 00000100:00080000:3.0:1788863966.067693:0:21240:0:(import.c:65:import_set_state_nolock()) ffff89e541eb6800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788863966.067700:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788863966.067705:0:21240:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e67af55500 x1875759226663424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788863972 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788863966.067713:0:21240:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788863966.067716:0:21240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:1.0:1788863966.068139:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875759226663424:0@lo:400:kworker.0 00010000:00010000:3.0:1788863966.069499:0:21240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863966.069516:0:21240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863966.069524:0:21240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863966.069530:0:21240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863966.069560:0:21240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788863966.069585:0:21240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863966.069595:0:21240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863966.069601:0:21240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863966.069607:0:21240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788863966.069627:0:21240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788863966.069632:0:21240:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788863966.069656:0:21240:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788863966.069660:0:21240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788863966.069664:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788863966.069670:0:21240:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788863966.069674:0:21240:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff89e543a1cd40) has no exports 00000020:00080000:3.0:1788863966.069694:0:21240:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff89e543a1cd40) has no exports 00010000:00010000:0.0:1788863966.070257:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788863966.070258:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788863966.070269:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863966.070286:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64259b600 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788863966.070290:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863966.070299:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788863966.070307:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788863966.070313:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788863966.070316:0:17049:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788863966.070318:0:17049:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788863966.070332:0:17049:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e5448c5800 00010000:00010000:0.0:1788863966.070335:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863966.070341:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e64259b600/0xf569beb9d4b6a1c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b6a1cf expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788863966.070354:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863966.070356:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788863966.070358:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863966.070970:0:21241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863966.070974:0:21241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788863966.070976:0:21241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863966.071060:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863966.071071:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98800 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788863966.071103:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863966.071113:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863966.071120:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863966.071127:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788863966.071129:0:17048:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788863966.071131:0:17048:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788863966.071152:0:17048:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e5448c5800 00010000:00010000:2.0:1788863966.071155:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863966.071163:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e681d98800/0xf569beb9d4b6a3c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b6a3c7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863966.071178:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863966.071180:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788863966.071182:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788863966.071436:0:21240:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e6761abb40 - data ffff89e671d30510/ffff89e680875400 00000020:01000000:3.0:1788863966.071582:0:21240:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff89e6761ab540 - data ffff89e671f51ca8/ffff89e68082a000 00100000:10000000:3.0:1788863966.082649:0:21240:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788863966.100123:0:21240:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a1dd 00000020:00000080:2.0:1788863966.100136:0:21240:0:(genops.c:885:class_export_put()) final put ffff89e5441f7000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788863966.100149:0:21240:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e5425b8000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788863966.100153:0:21240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e5425b8000 2 00000020:01000004:2.0:1788863966.100157:0:21240:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e5425b8000 from lustre-OST0001 00000020:00000080:2.0:1788863966.100183:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863966.100202:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5441f7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788863966.100205:0:21240:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788863966.100211:0:21240:0:(genops.c:885:class_export_put()) final put ffff89e5427b8000/lustre-OST0001_UUID 00000020:00000080:2.0:1788863966.100213:0:21240:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5427b8000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788863966.100238:0:21240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788863966.100367:0:21240:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import dea3065e-0e63-4370-a87c-9d4f07265d5e->MGS 00010000:00010000:2.0:1788863966.100383:0:21240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e542a3f800/0xf569beb9d4b69f28 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b69f2f expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863966.100407:0:21240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e542a3f800/0xf569beb9d4b69f28 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b69f2f expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863966.100415:0:21240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788863966.100418:0:21240:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788863966.100421:0:21240:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788863966.100436:0:21240:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e5448c5800 00010000:00010000:2.0:1788863966.100440:0:21240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e542a3f800/0xf569beb9d4b69f28 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b69f2f expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788863966.100465:0:21240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788863966.100472:0:21240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788863966.100479:0:21240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788863966.100481:0:21240:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788863966.100483:0:21240:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788863966.100494:0:21240:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e5448c5800 00010000:00010000:2.0:1788863966.100497:0:21240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e641536200/0xf569beb9d4b69e17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf569beb9d4b69e1e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788863966.100517:0:21240:0:(import.c:65:import_set_state_nolock()) ffff89e5448c5800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788863966.100521:0:21240:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788863966.100524:0:21240:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788863966.100525:0:21240:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788863966.100529:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788863966.100540:0:21240:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e67af57480 x1875759226663296/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788863971 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788863966.100564:0:21240:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788863966.100567:0:21240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:0.0:1788863966.100610:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dea3065e-0e63-4370-a87c-9d4f07265d5e:3639:1875759226663296:0@lo:250:kworker.0 10000000:01000000:2.0:1788863966.101607:0:21240:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788863966.101622:0:21240:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b69e02 00000020:00000080:2.0:1788863966.101629:0:21240:0:(genops.c:885:class_export_put()) final put ffff89e67f891800/dea3065e-0e63-4370-a87c-9d4f07265d5e 00000020:01000000:2.0:1788863966.101640:0:21240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.135@tcp (flags='') 00000020:00000080:2.0:1788863966.101645:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788863966.101651:0:21240:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.135@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788863966.101655:0:21240:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff89e5428e99c0) has no exports 10000000:01000000:0.0:1788863966.101744:0:17058:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788863966.101843:0:21240:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.204.135@tcp: client import never connected 00000100:00080000:2.0:1788863966.101855:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788863966.101858:0:21240:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788863966.101860:0:21240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788863966.101862:0:21240:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788863966.101902:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788863966.101908:0:21240:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.135@tcp (uuid dea3065e-0e63-4370-a87c-9d4f07265d5e) 00000020:01000000:2.0:1788863966.101914:0:21240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788863966.101917:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788863966.101922:0:21240:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788863966.101929:0:21240:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff89e5441f6800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:1.0:1788863966.101937:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e67f891800/dea3065e-0e63-4370-a87c-9d4f07265d5e for MGC192.168.204.135@tcp 00000020:00080000:2.0:1788863966.101940:0:21240:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff89e65d58cd40) has exports, disconnecting them 00000020:00080000:2.0:1788863966.101946:0:21240:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff89e5441f6800), last request at 1788863872 00000020:00000080:2.0:1788863966.101953:0:21240:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a207 00000020:00000080:1.0:1788863966.101957:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5448c5800 for MGC192.168.204.135@tcp 00000020:00000080:1.0:1788863966.101968:0:37:0:(genops.c:885:class_export_put()) final put ffff89e5448c6800/dea3065e-0e63-4370-a87c-9d4f07265d5e 00000020:00000080:1.0:1788863966.101971:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5448c6800/dea3065e-0e63-4370-a87c-9d4f07265d5e for MGC192.168.204.135@tcp 00000020:01000000:1.0:1788863966.101975:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.135@tcp (dea3065e-0e63-4370-a87c-9d4f07265d5e) 00000020:00080000:2.0:1788863966.102695:0:21240:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e5441f6800): rc 0 00000020:00000080:2.0:1788863966.102701:0:21240:0:(genops.c:885:class_export_put()) final put ffff89e5441f6800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788863966.102944:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5441f6800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788863966.116742:0:21240:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788863966.116752:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788863966.116757:0:21240:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788863966.116775:0:21240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788863966.116910:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e5448e6000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788863966.116994:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863966.117003:0:21240:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788863966.117008:0:21240:0:(genops.c:885:class_export_put()) final put ffff89e5441f4800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788863966.117011:0:21240:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5441f4800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788863966.117021:0:21240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788863966.117114:0:21240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788863966.117119:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863966.117125:0:21240:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788863966.117133:0:21240:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff89e541eb0000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788863966.117139:0:21240:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff89e66c64b380) has exports, disconnecting them 00000020:00080000:0.0:1788863966.117145:0:21240:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff89e541eb0000), last request at 1788863872 00000020:00000080:0.0:1788863966.117149:0:21240:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a21c 00000020:00080000:0.0:1788863966.117164:0:21240:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e541eb0000): rc 0 00000020:00000080:0.0:1788863966.117170:0:21240:0:(genops.c:885:class_export_put()) final put ffff89e541eb0000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788863966.117236:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e541eb0000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788863966.119382:0:21240:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788863966.119390:0:21240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788863966.119411:0:21240:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788863966.119418:0:21240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788863966.119658:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1788863966.119837:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff89e541eb6800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788863966.119881:0:21241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788863966.120150:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788863966.120253:0:17044:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff89e541f37000:17044] 1 exiting: rc = 0 00000100:00100000:3.0:1788863966.120443:0:17043:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff89e541f36a00:17043] 0 exiting: rc = 1 00000100:00100000:1.0:1788863966.120540:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.122145:0:17814:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff89e67b6bda00:17814] 3 exiting: rc = 0 00000100:00100000:0.0:1788863966.122176:0:17046:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff89e541f36000:17046] 1 exiting: rc = 0 00000100:00100000:2.0:1788863966.122272:0:17045:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff89e541f37400:17045] 0 exiting: rc = 1 00000100:00100000:3.0:1788863966.125033:0:17047:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff89e541f36600:17047] 2 exiting: rc = 0 00000100:00100000:1.0:1788863966.125156:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125165:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125172:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125180:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125186:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125192:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125198:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125203:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125208:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125213:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125219:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125224:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125229:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125234:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125239:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125244:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125249:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125255:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125274:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125279:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125283:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125288:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125292:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125299:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125304:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125310:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125316:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125322:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125328:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125335:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125340:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125346:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125351:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125357:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125362:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125367:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125372:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125377:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125382:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125386:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125404:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125410:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125415:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125420:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125425:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125429:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125434:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125438:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125443:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125634:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125644:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125649:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125654:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125666:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125671:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125677:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125682:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125688:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125693:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125699:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125704:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125709:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125714:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.125719:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788863966.126624:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788863966.126635:0:21240:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788863966.126641:0:21240:0:(genops.c:885:class_export_put()) final put ffff89e541eb3000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788863966.126645:0:21240:0:(genops.c:844:class_export_destroy()) destroying export ffff89e541eb3000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788863966.126655:0:21240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788863966.126701:0:21240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e5425b8000 1 00000020:00000080:1.0:1788863966.126706:0:21240:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf569beb9d4b6a1c1 00000020:00000080:1.0:1788863966.126712:0:21240:0:(genops.c:885:class_export_put()) final put ffff89e5425bd000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788863966.126769:0:21240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788863966.126774:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788863966.126780:0:21240:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788863966.126783:0:21240:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff89e542b699c0) has no exports 00000020:00000080:2.0:1788863966.129423:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425bd000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788863966.172412:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863966.172428:0:21240:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788863966.172433:0:21240:0:(genops.c:885:class_export_put()) final put ffff89e5425bb000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788863966.172438:0:21240:0:(genops.c:844:class_export_destroy()) destroying export ffff89e5425bb000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788863966.172454:0:21240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788863966.173437:0:21240:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89e5425bc800 00000020:01000000:0.0:1788863966.173474:0:21240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788863966.173480:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788863966.173486:0:21240:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788863966.173490:0:21240:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff89e67b6c4d40) has no exports 00000020:00000080:0.0:1788863966.173874:0:21240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788863966.173885:0:21240:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788863966.173889:0:21240:0:(genops.c:885:class_export_put()) final put ffff89e650815800/OSS_uuid 00000020:00000080:0.0:1788863966.173893:0:21240:0:(genops.c:844:class_export_destroy()) destroying export ffff89e650815800/OSS_uuid for OSS 00000020:01000000:0.0:1788863966.174040:0:21240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788863966.174175:0:19251:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff89e65d9b3800:19251] 4 exiting: rc = 0 00000100:00100000:0.0:1788863966.174286:0:19012:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff89e655c15400:19012] 3 exiting: rc = 0 00000100:00100000:0.0:1788863966.174347:0:18568:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff89e676cbc600:18568] 0 exiting: rc = 1 00000100:00100000:0.0:1788863966.174469:0:18570:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff89e676d87400:18570] 2 exiting: rc = 0 00000100:00080000:1.0:1788863966.175690:0:17056:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788863966.175941:0:18569:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff89e676cbda00:18569] 1 exiting: rc = 0 00000100:00100000:0.0:1788863966.177466:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177478:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177485:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177492:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177500:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177508:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177513:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177518:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177523:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177528:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177533:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177538:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177542:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177548:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177552:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177557:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177563:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177567:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177572:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177576:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177581:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177585:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177590:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177594:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177599:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177603:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177609:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177613:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177618:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177651:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177656:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177662:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177667:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177672:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177678:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177683:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177687:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177692:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177697:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177702:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177707:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177711:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177717:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177721:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177727:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177732:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177736:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177741:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177746:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177750:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177755:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177761:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177775:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177782:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177787:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177793:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177799:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177804:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177809:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177815:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177821:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177829:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177834:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.177839:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.178868:0:18571:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff89e676d87600:18571] 0 exiting: rc = 1 00000100:00100000:2.0:1788863966.179503:0:18572:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff89e676d87800:18572] 1 exiting: rc = 0 00000100:00100000:2.0:1788863966.179572:0:19852:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_002: service thread [ffff89e542735400:19852] 2 exiting: rc = 0 00000100:00100000:0.0:1788863966.180180:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180198:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180205:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180210:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180215:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180219:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180224:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180229:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180234:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180239:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180245:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180250:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180256:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180261:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180266:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180272:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180277:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180282:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180287:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180292:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180297:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180302:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180308:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180313:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180318:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180323:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180328:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180333:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180340:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180345:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180350:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180355:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180359:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180364:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180368:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180403:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180410:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180415:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180421:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180426:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180431:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180436:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180442:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180447:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180454:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180459:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180464:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180468:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180474:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180480:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180486:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180491:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180506:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180511:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180517:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180522:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180527:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180531:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180536:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180542:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180549:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180554:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180560:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.180565:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.182155:0:18573:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff89e67b617000:18573] 0 exiting: rc = 1 00000100:00100000:3.0:1788863966.182441:0:18574:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff89e67b616400:18574] 1 exiting: rc = 0 00000100:00100000:2.0:1788863966.185063:0:18575:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff89e67b617800:18575] 2 exiting: rc = 0 00000100:00100000:2.0:1788863966.186210:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186219:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186234:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186239:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186253:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186273:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186418:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186424:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186430:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186438:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186444:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186449:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186455:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186461:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186467:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186473:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186480:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186486:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186492:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186498:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186505:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186511:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186516:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186522:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186527:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186532:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186537:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186542:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186549:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186568:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186577:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186582:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186587:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186592:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186597:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186603:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186607:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186612:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186618:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186714:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186721:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186735:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186740:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186745:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186750:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186755:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186761:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186767:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186772:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186777:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186783:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186789:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186794:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186799:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186813:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186819:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186825:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186836:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186843:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186848:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186854:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186860:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186864:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788863966.186870:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.200444:0:18577:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff89e67b616e00:18577] 1 exiting: rc = 0 00000100:00100000:0.0:1788863966.200673:0:18576:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff89e67b616000:18576] 0 exiting: rc = 1 00000100:00100000:3.0:1788863966.201723:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201733:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201738:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201743:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201760:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201767:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201772:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201776:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201782:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201788:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201792:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201796:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201801:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201806:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201809:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201814:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201819:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201824:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201828:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201832:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201837:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201842:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201847:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201852:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201856:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201861:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201866:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201871:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201876:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201880:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201885:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201890:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201895:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201899:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201904:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201920:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201925:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201930:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201935:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201939:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201944:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201949:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201954:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201958:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201962:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201967:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201972:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201977:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201982:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201987:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201991:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.201996:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.202000:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.202004:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.202009:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.202013:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.202018:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.202023:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.202041:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.202048:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.202053:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.202059:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.202064:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788863966.202071:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788863966.205128:0:18578:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff89e543aed000:18578] 0 exiting: rc = 1 00000100:00100000:2.0:1788863966.205798:0:18579:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff89e542765600:18579] 1 exiting: rc = 0 00000100:00100000:0.0:1788863966.205920:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.205937:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.205968:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.205976:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.205995:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206001:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206006:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206012:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206018:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206024:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206031:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206037:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206042:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206048:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206069:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206112:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206120:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206127:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206133:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206139:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206145:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206150:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206155:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206162:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206167:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206173:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206195:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206203:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206208:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206225:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206233:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206240:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206246:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206251:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206258:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206265:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206272:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206286:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206309:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206322:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206329:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206334:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206341:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206346:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206353:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206359:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206366:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206372:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206379:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206386:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206419:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206426:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206430:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206435:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206441:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206447:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206452:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206457:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206463:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206469:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206474:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206480:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206486:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788863966.206500:0:21240:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788863966.229877:0:21240:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788863988.940680:0:22006:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788864000.462838:0:22607:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788864000.462844:0:22607:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788864000.462845:0:22607:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788864000.462960:0:22607:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89e680890800 00000020:01000004:1.0:1788864000.463744:0:22607:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788864000.463755:0:22607:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788864000.463775:0:22607:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89e6763c3380) 00000020:00000080:1.0:1788864000.463802:0:22607:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788864000.592507:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788864000.593234:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788864000.598775:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788864000.598985:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788864000.601583:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788864000.605472:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788864000.607098:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788864000.607375:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788864000.608000:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788864000.608537:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788864000.609850:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788864000.610921:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788864000.611689:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788864000.612547:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788864000.613580:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788864000.614106:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788864000.614334:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788864000.614637:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788864000.614938:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788864000.615693:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788864000.616016:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788864000.616253:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788864000.616571:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788864000.616860:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788864000.617070:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788864000.618213:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788864000.618445:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788864000.619063:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788864000.619659:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788864000.620046:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788864000.620337:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788864000.620584:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788864000.620941:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788864000.621255:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788864000.623859:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788864000.630591:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788864000.630876:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788864000.631665:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788864000.631964:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788864000.632485:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788864000.632754:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788864000.633007:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788864000.633499:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788864000.633780:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788864000.634283:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788864000.634672:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788864000.634903:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788864000.638263:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788864000.638919:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788864000.639301:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788864000.639919:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788864000.640370:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788864000.640703:0:22607:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788864000.641841:0:22607:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788864000.642679:0:22607:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788864000.642691:0:22607:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788864000.642709:0:22607:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b6a708 00000020:01000004:3.0:1788864000.642730:0:22607:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788864000.642736:0:22607:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788864000.642744:0:22607:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e680890800 from MGS 00000020:01000004:3.0:1788864000.642748:0:22607:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788864000.642763:0:22607:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff89e65d5899c0) 00000020:00000080:3.0:1788864000.642777:0:22607:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788864000.642860:0:22607:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e680890800 from MGS, refs=2 00080000:01000000:3.0:1788864000.642865:0:22607:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788864000.642871:0:22607:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b6a716 00000100:00100000:3.0:1788864000.643135:0:22607:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788864000.643302:0:22607:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788864000.643310:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788864000.644315:0:22607:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788864000.644326:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788864000.645577:0:22607:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788864000.645876:0:22607:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788864000.645883:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788864000.647925:0:22607:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788864000.647941:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788864000.648896:0:22607:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788864000.648907:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788864000.649970:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864000.649974:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864000.649976:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864000.650562:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864000.650565:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864000.650567:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864000.651231:0:22607:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788864000.657412:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788864000.666270:0:22607:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788864000.678001:0:22620:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788864000.678169:0:22607:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788864000.678253:0:22607:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788864000.681594:0:22607:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788864000.687394:0:22607:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788864000.687891:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788864000.687900:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788864000.688773:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788864000.688782:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788864000.689181:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788864000.689205:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788864000.691373:0:22607:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788864000.691393:0:22607:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.135@tcp' 00000020:01000004:0.0:1788864000.691395:0:22607:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788864000.691424:0:22607:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.135@tcp (typ=mgc) 00000020:00000080:0.0:1788864000.691436:0:22607:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.135@tcp (ffff89e66c64b380) 00000020:00000080:0.0:1788864000.691450:0:22607:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788864000.691538:0:22607:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e680850800@MGC192.168.204.135@tcp: add connection 192.168.204.135@tcp at head 00010000:00010000:0.0:1788864000.691704:0:22607:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.135@tcp-0 is initialized 00000040:01000000:0.0:1788864000.691724:0:22607:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788864000.692014:0:22625:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788864000.692039:0:22607:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.135@tcp (uuid 814b6715-5ca6-4ba3-b2fa-53a13bb79fd3) 00000020:00000080:0.0:1788864000.692050:0:22607:0:(genops.c:1384:class_connect()) connect: client 814b6715-5ca6-4ba3-b2fa-53a13bb79fd3, cookie 0xf569beb9d4b6a724 00000100:00080000:0.0:1788864000.692059:0:22607:0:(import.c:545:import_select_connection()) MGC192.168.204.135@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788864000.692066:0:22607:0:(import.c:666:import_select_connection()) MGC192.168.204.135@tcp: import ffff89e680850800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788864000.692130:0:22607:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438dc000 x1875759226663808/t0(0) o250->MGC192.168.204.135@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788864000.692176:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3639:1875759226663808:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788864000.692242:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788864000.692326:0:22607:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 814b6715-5ca6-4ba3-b2fa-53a13bb79fd3->MGS 00000020:01000004:0.0:1788864000.692350:0:22607:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788864000.692369:0:22607:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788864000.692382:0:22607:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff89e66c64cd40) 00000020:00000080:0.0:1788864000.692392:0:22607:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788864000.695235:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226663808 00000100:00100000:1.0:1788864000.695254:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226663808 00000100:00100000:1.0:1788864000.695315:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864000.695327:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3639:x1875759226663808:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788864000.695366:0:22621:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 814b6715-5ca6-4ba3-b2fa-53a13bb79fd3@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:1.0:1788864000.695427:0:22621:0:(genops.c:1384:class_connect()) connect: client 814b6715-5ca6-4ba3-b2fa-53a13bb79fd3, cookie 0xf569beb9d4b6a732 00000100:00080000:1.0:1788864000.695728:0:22621:0:(import.c:65:import_set_state_nolock()) ffff89e680896000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864000.695865:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+5:3639:x1875759226663808:12345-0@lo:250:mount.lustre.0 Request processed in 538us (3622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864000.695876:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864000.697224:0:3639:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.135@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788864000.697245:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.135@tcp: connect to target with instance 0 00000100:00080000:1.0:1788864000.697268:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.135@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788864000.697275:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788864000.697281:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e680850800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788864000.697284:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788864000.697299:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788864000.697309:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3639:1875759226663808:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1788864000.699352:0:22624:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1788864000.730802:0:22607:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788864000.733304:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788864000.733314:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788864000.744395:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788864000.744412:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788864000.745718:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788864000.745727:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788864000.746966:0:22607:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788864000.747184:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788864000.747190:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788864000.754416:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788864000.754430:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788864000.846461:0:22607:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788864000.846651:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788864000.846658:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788864000.856030:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788864000.856054:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788864000.862113:0:22607:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788864000.862330:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788864000.862337:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788864000.869934:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788864000.873525:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788864000.876544:0:22607:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788864000.876760:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788864000.876766:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788864000.877731:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788864000.877740:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788864000.878482:0:22607:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788864000.878657:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788864000.878663:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788864000.886792:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788864000.886812:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788864000.942987:0:22607:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788864000.944492:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788864000.944501:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788864000.951019:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788864000.951033:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788864000.955834:0:22607:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788864000.955847:0:22607:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788864000.956837:0:22607:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788864000.956866:0:22607:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788864000.956872:0:22607:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788864000.956971:0:22607:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788864000.957012:0:22607:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788864000.957017:0:22607:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788864000.957018:0:22607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788864000.957019:0:22607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788864000.957020:0:22607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788864000.957022:0:22607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788864000.957023:0:22607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788864000.957024:0:22607:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788864000.957025:0:22607:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788864000.957027:0:22607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788864000.957028:0:22607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788864000.957030:0:22607:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788864000.957032:0:22607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788864000.957034:0:22607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788864000.957035:0:22607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788864000.957036:0:22607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788864000.957037:0:22607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788864000.957038:0:22607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788864000.957039:0:22607:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788864000.957041:0:22607:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788864000.957042:0:22607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788864000.957042:0:22607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788864000.957069:0:22607:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788864000.957122:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226663936:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788864000.957191:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864000.957246:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64554ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788864000.957421:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226663936 00000100:00100000:2.0:1788864000.957428:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226663936 00000100:00100000:2.0:1788864000.957466:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788864000.957475:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+5:22607:x1875759226663936:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788864000.957510:0:22623:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788864000.957519:0:22623:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788864000.957522:0:22623:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788864000.957876:0:22644:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788864000.963948:0:22623:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1788864000.969268:0:22645:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788864000.969277:0:22645:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788864000.969287:0:22645:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788864000.969290:0:22645:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788864000.970270:0:22645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788864000.970870:0:22623:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788864000.970881:0:22623:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788864000.984889:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+5:22607:x1875759226663936:12345-0@lo:253:mount.lustre.0 Request processed in 27406us (27688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864000.984909:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788864000.985039:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226663936:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788864000.985055:0:22607:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788864000.985059:0:22607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788864000.985061:0:22607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788864000.985062:0:22607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864000.985063:0:22607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788864000.985064:0:22607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864000.985065:0:22607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864000.985066:0:22607:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788864000.985068:0:22607:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788864000.985070:0:22607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864000.985071:0:22607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788864000.985152:0:22607:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e680890800 from lustre-MDT0000 10000000:01000000:1.0:1788864000.985194:0:22607:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788864000.985197:0:22607:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788864000.985202:0:22607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff89e66c64b380 10000000:01000000:1.0:1788864000.985207:0:22607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788864000.985216:0:22607:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff89e66c64b380 from 1 10000000:01000000:1.0:1788864000.985219:0:22607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788864000.985271:0:22607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864000.985283:0:22607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864000.985292:0:22607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864000.985311:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226664064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788864000.985352:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864000.985401:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6487a3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788864000.985487:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226664064 00000100:00100000:2.0:1788864000.985493:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226664064 00000100:00100000:2.0:1788864000.985541:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788864000.985550:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+5:22607:x1875759226664064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788864000.985563:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864000.985576:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e6808bcc00/0xf569beb9d4b6a740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a739 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864000.985611:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e6808bcc00/0xf569beb9d4b6a740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a739 expref: 6 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864000.985621:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e6808bcc00/0xf569beb9d4b6a740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a739 expref: 6 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864000.985630:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bcc00, rc 0) 00000100:00100000:2.0:1788864000.985666:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+6:22607:x1875759226664064:12345-0@lo:101:mount.lustre.0 Request processed in 117us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864000.985672:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788864000.986110:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226664064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864000.986125:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a740 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864000.986133:0:22607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a740 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864000.986191:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226664192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864000.986222:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864000.986259:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64554be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788864000.986322:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226664192 00000100:00100000:1.0:1788864000.986326:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226664192 00000100:00100000:1.0:1788864000.986350:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864000.986357:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+6:22607:x1875759226664192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864000.986439:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+6:22607:x1875759226664192:12345-0@lo:501:mount.lustre.0 Request processed in 83us (217us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788864000.986447:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788864000.986815:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226664192:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788864000.986848:0:22607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788864000.986867:0:22607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a740 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864000.986876:0:22607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a740 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864000.986885:0:22607:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e680890800 10000000:01000000:0.0:1788864000.986890:0:22607:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788864000.986894:0:22607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89e680890800 10000000:01000000:0.0:1788864000.986897:0:22607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788864000.986912:0:22607:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff89e680890800 from 1 10000000:01000000:0.0:1788864000.986915:0:22607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788864000.986955:0:22607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357d000/0xf569beb9d4b6a747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864000.986963:0:22607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e54357d000/0xf569beb9d4b6a747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864000.986972:0:22607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e54357d000/0xf569beb9d4b6a747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864000.986986:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226664320:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788864000.987015:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864000.987038:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64554be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788864000.987147:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226664320 00000100:00100000:3.0:1788864000.987151:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226664320 00000100:00100000:3.0:1788864000.987181:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788864000.987188:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+6:22607:x1875759226664320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864000.987196:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864000.987208:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167c800/0xf569beb9d4b6a74e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a747 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864000.987233:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167c800/0xf569beb9d4b6a74e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a747 expref: 7 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864000.987242:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167c800/0xf569beb9d4b6a74e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a747 expref: 7 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864000.987249:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167c800, rc 0) 00000100:00100000:3.0:1788864000.987281:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+7:22607:x1875759226664320:12345-0@lo:101:mount.lustre.0 Request processed in 94us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864000.987287:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788864000.988117:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226664320:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864000.988134:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e54357d000/0xf569beb9d4b6a747 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a74e expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864000.988144:0:22607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e54357d000/0xf569beb9d4b6a747 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a74e expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864000.988160:0:22607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788864000.988174:0:22607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357d000/0xf569beb9d4b6a747 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a74e expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864000.988182:0:22607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e54357d000/0xf569beb9d4b6a747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a74e expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864000.988189:0:22607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788864000.988201:0:22607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788864000.988208:0:22607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89e680890800 10000000:01000000:0.0:1788864000.988211:0:22607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788864000.988215:0:22607:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788864000.988217:0:22607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788864000.988239:0:22607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357d400/0xf569beb9d4b6a755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864000.988246:0:22607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e54357d400/0xf569beb9d4b6a755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864000.988253:0:22607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e54357d400/0xf569beb9d4b6a755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864000.988269:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226664448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788864000.988305:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864000.988342:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64554be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788864000.988360:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226664448 00000100:00100000:0.0:1788864000.988364:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226664448 00000100:00100000:0.0:1788864000.988396:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788864000.988403:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+7:22607:x1875759226664448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864000.988413:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864000.988424:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e54357cc00/0xf569beb9d4b6a75c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a755 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864000.988439:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e54357cc00/0xf569beb9d4b6a75c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a755 expref: 8 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864000.988447:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e54357cc00/0xf569beb9d4b6a75c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a755 expref: 8 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864000.988466:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e54357cc00, rc 0) 00000100:00100000:0.0:1788864000.988496:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+8:22607:x1875759226664448:12345-0@lo:101:mount.lustre.0 Request processed in 93us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864000.988502:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788864000.988921:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226664448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864000.988949:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e54357d400/0xf569beb9d4b6a755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a75c expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864000.988958:0:22607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e54357d400/0xf569beb9d4b6a755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a75c expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864000.989015:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226664576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864000.989046:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864000.989071:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64554be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788864000.989337:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226664576 00000100:00100000:3.0:1788864000.989343:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226664576 00000100:00100000:3.0:1788864000.989368:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788864000.989375:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+8:22607:x1875759226664576:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864000.989511:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+9:22607:x1875759226664576:12345-0@lo:501:mount.lustre.0 Request processed in 137us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864000.989518:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788864000.989924:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226664576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864000.990063:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226664704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788864000.990145:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864000.990180:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64554be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788864000.990433:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226664704 00000100:00100000:3.0:1788864000.990438:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226664704 00000100:00100000:3.0:1788864000.990477:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788864000.990484:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+9:22607:x1875759226664704:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788864000.991732:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+9:22607:x1875759226664704:12345-0@lo:503:mount.lustre.0 Request processed in 1242us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864000.991743:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788864001.000962:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226664704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788864001.001779:0:22646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22646:1875759226664832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788864001.001863:0:22646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864001.001924:0:22646:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302840 going to sleep for 11 seconds 00000100:00100000:2.0:1788864001.002123:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226664832 00000100:00100000:2.0:1788864001.002130:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226664832 00000100:00100000:2.0:1788864001.002184:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788864001.002193:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+9:22646:x1875759226664832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788864001.012577:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+9:22646:x1875759226664832:12345-0@lo:502:llog_process_th.0 Request processed in 10375us (10704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864001.012603:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788864001.012797:0:22646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22646:1875759226664832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788864001.012837:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864001.012849:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.012863:0:22646:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788864001.012869:0:22646:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788864001.012872:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788864001.012890:0:22646:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89e6763c19c0) 00000020:00000080:1.0:1788864001.012912:0:22646:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788864001.012918:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788864001.013032:0:22646:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788864001.013039:0:22646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b6a76a 00000020:00000080:1.0:1788864001.013277:0:22646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788864001.013282:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864001.013286:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.013287:0:22646:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788864001.013290:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864001.013294:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.013295:0:22646:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788864001.013298:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788864001.013306:0:22646:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff89e6763c4d40) 00000020:00000080:1.0:1788864001.013317:0:22646:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788864001.013321:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788864001.013323:0:22646:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788864001.013326:0:22646:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788864001.013331:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788864001.013386:0:22646:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e680890800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788864001.013401:0:22646:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff89e6763c0000) 00000020:00000080:1.0:1788864001.013409:0:22646:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788864001.013463:0:22646:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788864001.013468:0:22646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b6a77f 00000020:00000080:1.0:1788864001.013555:0:22646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788864001.013560:0:22646:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788864001.013565:0:22646:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf569beb9d4b6a786 00080000:01000000:1.0:1788864001.013569:0:22646:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788864001.013572:0:22646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b6a78d 00010000:00010000:0.0:1788864001.233989:0:22646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788864001.235432:0:22646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:0.0:1788864001.239544:0:22646:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788864001.240442:0:22646:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff89e66c648000) 00000020:00000080:0.0:1788864001.240460:0:22646:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788864001.240550:0:22646:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788864001.240557:0:22646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b6a79b 00000020:00000080:1.0:1788864001.244975:0:22646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788864001.262542:0:22646:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf569beb9d4b6a7a2 00000020:00000080:3.0:1788864001.263522:0:22646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788864001.263534:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864001.263541:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864001.263543:0:22646:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788864001.263546:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788864001.263549:0:22646:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788864001.263550:0:22646:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788864001.263552:0:22646:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788864001.263553:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788864001.263555:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864001.263557:0:22646:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788864001.263560:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788864001.263564:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864001.263565:0:22646:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788864001.263569:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788864001.263636:0:22646:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788864001.263654:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864001.263658:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864001.263659:0:22646:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788864001.263662:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788864001.263665:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864001.263666:0:22646:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788864001.263669:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788864001.263674:0:22646:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:00000080:3.0:1788864001.264205:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788864001.264225:0:22646:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff89e65d588000) 00000020:00000080:3.0:1788864001.264244:0:22646:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788864001.264252:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788864001.264409:0:22646:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788864001.264420:0:22646:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788864001.264427:0:22646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b6a7b0 00010000:00080000:3.0:1788864001.264463:0:22646:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e676197800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1788864001.275053:0:22646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788864001.278156:0:22646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788864001.278171:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788864001.278202:0:22646:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788864001.278223:0:22646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b6a7b7 00000100:00080000:1.0:1788864001.278234:0:22646:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788864001.278246:0:22646:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89e676197800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788864001.278559:0:22646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544208a80 x1875759226664960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788864001.278658:0:22646:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788864001.278892:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864001.278898:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.278900:0:22646:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788864001.278903:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788864001.278905:0:22646:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788864001.278907:0:22646:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788864001.278908:0:22646:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788864001.278910:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788864001.278912:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.278913:0:22646:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788864001.278915:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788864001.278920:0:22646:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788864001.278923:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.278924:0:22646:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788864001.278927:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788864001.278931:0:22646:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:1.0:1788864001.278952:0:22646:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788864001.278955:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788864001.278968:0:22646:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89e658628000) 00000020:00000080:1.0:1788864001.278979:0:22646:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788864001.278982:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788864001.279036:0:22646:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788864001.279048:0:22646:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788864001.279053:0:22646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b6a7c5 00000100:00100000:2.0:1788864001.279257:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226664960:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788864001.279331:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864001.279502:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226664960 00000100:00100000:0.0:1788864001.279511:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226664960 00000100:00100000:0.0:1788864001.279545:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788864001.279552:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226664960:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788864001.279568:0:22633:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788864001.280535:0:22646:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e544177000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1788864001.281363:0:22646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788864001.287139:0:22646:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788864001.288387:0:22646:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788864001.292682:0:22646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788864001.293525:0:22646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788864001.300536:0:22646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00080000:1.0:1788864001.304529:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676197800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864001.304543:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788864001.304548:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226664960:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788864001.307536:0:22652:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788864001.307545:0:22652:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1788864001.309563:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226664960:12345-0@lo:38:llog_process_th.0 Request processed in 30000us (30222us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788864001.309578:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:3.0:1788864001.318379:0:22646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788864001.318395:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788864001.318438:0:22646:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788864001.318457:0:22646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b6a7cc 00000100:00080000:3.0:1788864001.318468:0:22646:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788864001.318478:0:22646:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89e544177000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788864001.318512:0:22646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543925180 x1875759226665088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788864001.318596:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226665088:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788864001.318652:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226665088 offset 0 length 520: 4 00000100:00080000:3.0:1788864001.318726:0:22646:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788864001.318791:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864001.318796:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864001.318798:0:22646:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788864001.318801:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788864001.318804:0:22646:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788864001.318806:0:22646:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788864001.318807:0:22646:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788864001.318808:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788864001.318811:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864001.318812:0:22646:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788864001.318814:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788864001.318818:0:22646:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788864001.318821:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864001.318823:0:22646:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788864001.318826:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788864001.318830:0:22646:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:3.0:1788864001.318851:0:22646:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788864001.318853:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788864001.318878:0:22646:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89e65d58b380) 00000020:00000080:3.0:1788864001.318890:0:22646:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788864001.318896:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788864001.318966:0:22646:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788864001.318972:0:22646:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788864001.318977:0:22646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf569beb9d4b6a7da 00010000:00080000:3.0:1788864001.319005:0:22646:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e67c45b800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788864001.329447:0:22646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788864001.329538:0:22646:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788864001.329554:0:22646:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788864001.345513:0:22646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864001.349445:0:22646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788864001.349688:0:22646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788864001.351043:0:22654:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788864001.351051:0:22654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788864001.357232:0:22646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788864001.357246:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788864001.357290:0:22646:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788864001.357541:0:22646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b6a7e1 00000100:00080000:3.0:1788864001.357552:0:22646:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788864001.357563:0:22646:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e67c45b800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788864001.357679:0:22646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543925c00 x1875759226665216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788864001.357793:0:22646:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788864001.357875:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864001.357881:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864001.357883:0:22646:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788864001.357886:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788864001.357890:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864001.357892:0:22646:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788864001.357894:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788864001.357896:0:22646:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788864001.357899:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864001.357901:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864001.357910:0:22646:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788864001.357914:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788864001.357916:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864001.357917:0:22646:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788864001.357920:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788864001.357957:0:22646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22646:1875759226665344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788864001.358036:0:22646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864001.358243:0:22646:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6763023c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864001.358449:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226665216:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788864001.358483:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226665216 offset 0 length 520: 4 00000100:00100000:2.0:1788864001.363349:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226665344 00000100:00100000:2.0:1788864001.363367:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226665344 00000100:00100000:2.0:1788864001.363501:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788864001.363514:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+9:22646:x1875759226665344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788864001.364262:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+9:22646:x1875759226665344:12345-0@lo:502:llog_process_th.0 Request processed in 749us (6223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864001.364272:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788864001.368243:0:22646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22646:1875759226665344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788864001.368312:0:22646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864001.368324:0:22646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.368326:0:22646:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788864001.368331:0:22646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788864001.369216:0:22607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788864001.369248:0:22607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788864001.369268:0:22607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357d400/0xf569beb9d4b6a755 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a75c expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.369280:0:22607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e54357d400/0xf569beb9d4b6a755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a75c expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864001.369287:0:22607:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e680890800 from 1 10000000:01000000:0.0:1788864001.369290:0:22607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788864001.369342:0:22607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.369350:0:22607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.369361:0:22607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864001.369384:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226665472:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788864001.369461:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864001.369577:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c65db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788864001.372001:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226665472 00000100:00100000:2.0:1788864001.372015:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226665472 00000100:00100000:2.0:1788864001.372108:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788864001.372118:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+9:22607:x1875759226665472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788864001.372135:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864001.372155:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a7ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a7e8 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864001.372181:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a7ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a7e8 expref: 10 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864001.372190:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a7ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a7e8 expref: 10 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864001.372199:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bc600, rc 0) 00000100:00100000:2.0:1788864001.372264:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+10:22607:x1875759226665472:12345-0@lo:101:mount.lustre.0 Request processed in 148us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864001.372270:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788864001.372533:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226665472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864001.372552:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a7ef expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.372562:0:22607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a7ef expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864001.373405:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226665600:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788864001.373458:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864001.373491:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c65db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788864001.374840:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226665600 00000100:00100000:2.0:1788864001.374852:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226665600 00000100:00100000:2.0:1788864001.374912:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788864001.374922:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+10:22607:x1875759226665600:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788864001.374943:0:22623:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788864001.374949:0:22623:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788864001.375055:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+10:22607:x1875759226665600:12345-0@lo:256:mount.lustre.0 Request processed in 134us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864001.375062:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788864001.375859:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226665600:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788864001.377850:0:22607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788864001.377875:0:22607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a7ef expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.377888:0:22607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a7ef expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864001.377899:0:22607:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e680890800 from 1 10000000:01000000:0.0:1788864001.377902:0:22607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788864001.377951:0:22607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.377959:0:22607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.378046:0:22607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864001.378071:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226665728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788864001.379446:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864001.379494:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c65db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788864001.381818:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226665728 00000100:00100000:1.0:1788864001.381836:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226665728 00000100:00100000:1.0:1788864001.381902:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788864001.381912:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+10:22607:x1875759226665728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788864001.381929:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864001.381952:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e640031000/0xf569beb9d4b6a7fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a7f6 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864001.381993:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640031000/0xf569beb9d4b6a7fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a7f6 expref: 11 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864001.382004:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e640031000/0xf569beb9d4b6a7fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a7f6 expref: 11 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864001.382012:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031000, rc 0) 00000100:00100000:1.0:1788864001.382138:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+11:22607:x1875759226665728:12345-0@lo:101:mount.lustre.0 Request processed in 228us (2694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864001.382145:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788864001.383778:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226665728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864001.383807:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a7fd expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.383821:0:22607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a7fd expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864001.383911:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226665856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864001.383960:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864001.384021:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c65db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788864001.384251:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226665856 00000100:00100000:3.0:1788864001.384258:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226665856 00000100:00100000:3.0:1788864001.384301:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788864001.384309:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+11:22607:x1875759226665856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864001.384447:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+11:22607:x1875759226665856:12345-0@lo:501:mount.lustre.0 Request processed in 138us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864001.384454:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788864001.385775:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226665856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864001.385831:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226665984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788864001.385906:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864001.385944:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c65db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788864001.386109:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226665984 00000100:00100000:2.0:1788864001.386116:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226665984 00000100:00100000:2.0:1788864001.386169:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788864001.386177:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+11:22607:x1875759226665984:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788864001.386284:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+11:22607:x1875759226665984:12345-0@lo:503:mount.lustre.0 Request processed in 107us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864001.386291:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788864001.386610:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226665984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788864001.388053:0:22656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22656:1875759226666112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864001.388151:0:22656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864001.388200:0:22656:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64610ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788864001.388306:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226666112 00000100:00100000:0.0:1788864001.388314:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226666112 00000100:00100000:0.0:1788864001.388363:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788864001.388372:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+11:22656:x1875759226666112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864001.389347:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+11:22656:x1875759226666112:12345-0@lo:502:llog_process_th.0 Request processed in 971us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864001.389367:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788864001.389502:0:22656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22656:1875759226666112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788864001.389533:0:22656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864001.389543:0:22656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.389545:0:22656:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788864001.389551:0:22656:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e680890800 00000020:00000080:1.0:1788864001.389553:0:22656:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788864001.389562:0:22656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864001.389564:0:22656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.389565:0:22656:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788864001.389568:0:22656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864001.389569:0:22656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.389571:0:22656:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788864001.389574:0:22656:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e680890800 00000020:00000080:1.0:1788864001.389582:0:22656:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788864001.389659:0:22656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864001.389663:0:22656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.389664:0:22656:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788864001.389667:0:22656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864001.389670:0:22656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.389671:0:22656:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788864001.389675:0:22656:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e680890800 00000020:00000080:1.0:1788864001.389677:0:22656:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788864001.389706:0:22656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864001.389717:0:22656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.389718:0:22656:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788864001.389721:0:22656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864001.389723:0:22656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.389725:0:22656:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788864001.389728:0:22656:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e680890800 00000020:00000080:1.0:1788864001.389730:0:22656:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788864001.389776:0:22656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22656:1875759226666240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864001.389820:0:22656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864001.389861:0:22656:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64610ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788864001.396323:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226666240 00000100:00100000:0.0:1788864001.396339:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226666240 00000100:00100000:0.0:1788864001.396416:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788864001.396427:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+11:22656:x1875759226666240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864001.396614:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+11:22656:x1875759226666240:12345-0@lo:502:llog_process_th.0 Request processed in 188us (6793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864001.396622:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788864001.396890:0:22656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22656:1875759226666240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788864001.396931:0:22656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864001.396939:0:22656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864001.396941:0:22656:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788864001.396945:0:22656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788864001.398018:0:22607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788864001.398051:0:22607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788864001.398105:0:22607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a7fd expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.398119:0:22607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a7fd expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864001.398179:0:22607:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788864001.398182:0:22607:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e680890800 10000000:01000000:0.0:1788864001.398185:0:22607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e680890800 10000000:01000000:0.0:1788864001.398189:0:22607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788864001.398194:0:22607:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e680890800 from 1 10000000:01000000:0.0:1788864001.398197:0:22607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788864001.398231:0:22607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357d600/0xf569beb9d4b6a804 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.398240:0:22607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e54357d600/0xf569beb9d4b6a804 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.398250:0:22607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e54357d600/0xf569beb9d4b6a804 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864001.398281:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226666368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788864001.398352:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864001.398396:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c65de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788864001.398420:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226666368 00000100:00100000:0.0:1788864001.398427:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226666368 00000100:00100000:0.0:1788864001.398461:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788864001.398468:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+11:22607:x1875759226666368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864001.398479:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864001.398491:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e54357d800/0xf569beb9d4b6a80b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a804 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.398511:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e54357d800/0xf569beb9d4b6a80b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a804 expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.398521:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e54357d800/0xf569beb9d4b6a80b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a804 expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.398528:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e54357d800, rc 0) 00000100:00100000:0.0:1788864001.398562:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22607:x1875759226666368:12345-0@lo:101:mount.lustre.0 Request processed in 92us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864001.398568:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788864001.398630:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226666368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864001.398645:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e54357d600/0xf569beb9d4b6a804 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a80b expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.398653:0:22607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e54357d600/0xf569beb9d4b6a804 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a80b expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864001.398731:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226666496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864001.398756:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864001.398768:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c65de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788864001.401927:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226666496 00000100:00100000:1.0:1788864001.401944:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226666496 00000100:00100000:1.0:1788864001.402000:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788864001.402009:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22607:x1875759226666496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864001.402206:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22607:x1875759226666496:12345-0@lo:501:mount.lustre.0 Request processed in 196us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864001.402224:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788864001.403158:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226666496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864001.403214:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226666624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788864001.403277:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864001.403328:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c65de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788864001.403520:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226666624 00000100:00100000:1.0:1788864001.403527:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226666624 00000100:00100000:1.0:1788864001.403565:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788864001.403574:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22607:x1875759226666624:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788864001.403682:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22607:x1875759226666624:12345-0@lo:503:mount.lustre.0 Request processed in 109us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864001.403689:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788864001.409645:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226666624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788864001.431924:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22661:1875759226666752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864001.432002:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864001.432041:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226666752 00000100:00100000:0.0:1788864001.432048:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226666752 00000100:00100000:0.0:1788864001.432123:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788864001.432132:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22661:x1875759226666752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864001.432241:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22661:x1875759226666752:12345-0@lo:502:llog_process_th.0 Request processed in 109us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864001.432248:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788864001.432297:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c65d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788864001.432317:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22661:1875759226666752:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788864001.432370:0:22661:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788864001.432384:0:22661:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89e66c6499c0) 00000020:00000080:0.0:1788864001.432404:0:22661:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788864001.432481:0:22661:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e680890800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788864001.432485:0:22661:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e680890800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788864001.432487:0:22661:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e680890800 4 00010000:00080000:0.0:1788864001.432525:0:22661:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e541e74000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1788864001.445055:0:22661:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788864001.445847:0:22661:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788864001.447549:0:22661:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788864001.447571:0:22661:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf569beb9d4b6a819 00000100:00080000:1.0:1788864001.447595:0:22661:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788864001.447609:0:22661:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89e541e74000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788864001.447649:0:22661:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544208a80 x1875759226666880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788864001.447712:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226666880:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788864001.447785:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788864001.447850:0:22661:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788864001.449038:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226666880 00000100:00100000:1.0:1788864001.449050:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226666880 00000100:00100000:1.0:1788864001.449279:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864001.449286:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226666880:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788864001.449379:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226666880:12345-0@lo:38:llog_process_th.0 Request processed in 92us (1593us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788864001.449386:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864001.449434:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788864001.449442:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e541e74000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864001.449445:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788864001.449448:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226666880:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788864001.451407:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22661:1875759226667008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788864001.453353:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864001.453412:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64610ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788864001.459044:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226667008 00000100:00100000:0.0:1788864001.459061:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226667008 00000100:00100000:0.0:1788864001.459156:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788864001.459165:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22661:x1875759226667008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864001.459857:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22661:x1875759226667008:12345-0@lo:502:llog_process_th.0 Request processed in 690us (6509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864001.459866:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788864001.460057:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22661:1875759226667008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864001.461034:0:22661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22661:1875759226667136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864001.461197:0:22661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864001.461247:0:22661:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c65d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788864001.461273:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226667136 00000100:00100000:0.0:1788864001.461279:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226667136 00000100:00100000:0.0:1788864001.461318:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788864001.461325:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22661:x1875759226667136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788864001.461426:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22661:x1875759226667136:12345-0@lo:502:llog_process_th.0 Request processed in 100us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864001.461433:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788864001.461483:0:22661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22661:1875759226667136:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788864001.461505:0:22661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788864001.466185:0:22607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788864001.466225:0:22607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788864001.466249:0:22607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357d600/0xf569beb9d4b6a804 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a80b expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864001.466274:0:22607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e54357d600/0xf569beb9d4b6a804 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a80b expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788864001.466327:0:22607:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788864001.466330:0:22607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788864001.466331:0:22607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788864001.466332:0:22607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788864001.466334:0:22607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788864001.466335:0:22607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788864001.466336:0:22607:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788864001.466337:0:22607:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788864001.466339:0:22607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788864001.466340:0:22607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788864001.466344:0:22607:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788864001.466346:0:22607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788864001.466348:0:22607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788864001.466349:0:22607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788864001.466349:0:22607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788864001.466351:0:22607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788864001.466351:0:22607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788864001.466353:0:22607:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788864001.466353:0:22607:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788864001.466354:0:22607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788864001.466355:0:22607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788864001.466396:0:22607:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788864001.466417:0:22607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226667264:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788864001.466484:0:22607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864001.466529:0:22607:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c65d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788864001.466559:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226667264 00000100:00100000:0.0:1788864001.466566:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226667264 00000100:00100000:0.0:1788864001.467307:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788864001.467319:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22607:x1875759226667264:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788864001.467350:0:22622:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788864001.467371:0:22622:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788864001.474763:0:22622:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788864001.474791:0:22622:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788864001.474969:0:22644:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788864001.474974:0:22644:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788864001.474996:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.475014:0:22644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a7ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a7e8 expref: 12 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.475023:0:22644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.475063:0:22644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a7ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a7e8 expref: 12 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.475113:0:22644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a7ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a7e8 expref: 12 pid: 22623 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864001.475143:0:22644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226667392:0@lo:104: 00000100:00100000:3.0:1788864001.475213:0:22644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864001.475257:0:22644:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5410ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1788864001.475300:0:22611:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226667392 00000100:00100000:3.0:1788864001.475307:0:22611:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226667392 00000100:00100000:3.0:1788864001.475353:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788864001.475363:0:22611:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:22644:x1875759226667392:12345-0@lo:104: 00010000:00010000:3.0:1788864001.475377:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a7ef expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.475429:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788864001.475434:0:22611:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:22644:x1875759226667392:12345-0@lo:104: Request processed in 74us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864001.475440:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788864001.475478:0:22644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226667392:0@lo:104: 00010000:00010000:3.0:1788864001.475497:0:22644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.475514:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864001.475521:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a7ef expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.475528:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e54357c000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788864001.475532:0:22617:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a7ef expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.475540:0:22617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a7ef expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788864001.475554:0:22617:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a7ef expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864001.475559:0:22617:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788864001.475604:0:22617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a7ef expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.475611:0:22617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788864001.475642:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a7ef expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.475649:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a7e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a7ef expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.475667:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864001.475669:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864001.475670:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864001.475688:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226667520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864001.475732:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864001.475957:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22607:x1875759226667264:12345-0@lo:253:mount.lustre.0 Request processed in 8640us (9472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864001.475967:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788864001.476011:0:22607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22607:1875759226667264:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788864001.476021:0:22607:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788864001.476024:0:22607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788864001.476026:0:22607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788864001.476027:0:22607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788864001.476028:0:22607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788864001.476029:0:22607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788864001.476030:0:22607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788864001.476031:0:22607:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788864001.476033:0:22607:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788864001.476035:0:22607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788864001.476036:0:22607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788864001.476046:0:22607:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788864001.477241:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226667520 00000100:00100000:3.0:1788864001.477253:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226667520 00010000:00010000:3.0:1788864001.477286:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a7ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a7e8 expref: 12 pid: 22623 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864001.477321:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788864001.477328:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:3642:x1875759226667520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864001.477342:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864001.477347:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a7ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a7e8 expref: 12 pid: 22623 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.477358:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a7ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a7e8 expref: 12 pid: 22623 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.477381:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a7ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a7e8 expref: 12 pid: 22623 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.477397:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.477404:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788864001.477421:0:22613:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002446958s 00010000:00010000:3.0:1788864001.477425:0:22613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.477431:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.477438:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.477445:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.477450:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167ce00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864001.477454:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.477462:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.477474:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.477489:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864001.477548:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+11:3642:x1875759226667520:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864001.477555:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864001.477619:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226667520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864001.479185:0:22644:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.479205:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864001.479213:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167ce00/0xf569beb9d4b6a820 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788864001.537660:0:22607:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1788864001.538323:0:22607:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788864001.538588:0:22669:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788864001.538937:0:22669:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788864001.539640:0:22607:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:2.0:1788864001.539853:0:22668:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1788864001.539858:0:22668:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1788864001.542728:0:22607:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788864001.542774:0:22607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788864001.544268:0:22670:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff89e67af55c00 x1875759226667648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864001.544280:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00000040:00080000:1.0:1788864001.545920:0:22669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788864001.546011:0:22669:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:0.0:1788864001.547473:0:22607:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788864001.547494:0:22607:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788864001.547590:0:22607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788864001.548639:0:22607:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788864001.550576:0:22607:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788864001.551180:0:22607:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788864001.551886:0:22607:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1788864001.552675:0:22607:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1788864001.558498:0:22607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788864001.561158:0:22607:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788864001.561199:0:22607:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa4a9c1097988 00100000:10000000:1.0:1788864001.561207:0:22607:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788864001.567952:0:22607:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788864001.567970:0:22607:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788864001.567990:0:22607:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788864001.568007:0:22607:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788864001.575486:0:22607:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788864001.575665:0:22607:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788864001.707417:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788864002.475645:0:22662:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788864002.475655:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 10000000:01000000:1.0:1788864002.477111:0:22625:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788864002.477124:0:22625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e680890800 from 11 10000000:01000000:1.0:1788864002.477129:0:22625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788864002.477170:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864002.477182:0:22625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864002.477194:0:22625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864002.477222:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226667776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788864002.477291:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864002.477341:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788864002.477406:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226667776 00000100:00100000:3.0:1788864002.477414:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226667776 00000100:00100000:3.0:1788864002.477467:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788864002.477477:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+11:22625:x1875759226667776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864002.477490:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864002.477504:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167dc00/0xf569beb9d4b6a82e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a827 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864002.477527:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167dc00/0xf569beb9d4b6a82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a827 expref: 12 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864002.477537:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167dc00/0xf569beb9d4b6a82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a827 expref: 12 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864002.477555:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167dc00, rc 0) 00000100:00100000:3.0:1788864002.477593:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22625:x1875759226667776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864002.477599:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788864002.477686:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226667776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864002.477700:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a82e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864002.477708:0:22625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a82e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864002.477755:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226667904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788864002.477784:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864002.477815:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676302a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788864002.477858:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226667904 00000100:00100000:3.0:1788864002.477863:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226667904 00000100:00100000:3.0:1788864002.477893:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788864002.477900:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22625:x1875759226667904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788864002.477914:0:22622:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788864002.477930:0:22622:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788864002.477946:0:22622:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788864002.478023:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:22625:x1875759226667904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864002.478031:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788864002.478116:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226667904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788864002.478154:0:22625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788864002.478160:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a82e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864002.478177:0:22625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a82e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788864002.488534:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788864002.488548:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788864002.605240:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788864002.737459:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788864003.499786:0:22662:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788864003.499797:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788864003.499927:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788864003.499968:0:22662:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788864003.500147:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1788864003.631045:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788864003.757362:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864004.658759:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788864004.779226:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864005.675222:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788864005.804197:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788864006.635451:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788864006.635459:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788864006.635463:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e676197800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788864006.635473:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 668 00000100:00080000:0.0:1788864006.635490:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788864006.635504:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89e676197800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788864006.635532:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438dea00 x1875759226668160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788864006.635549:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864006.635552:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788864006.635555:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864006.635558:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788864006.635561:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788864006.635563:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788864006.635565:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e541e74000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788864006.635570:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89e541e74000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788864006.635582:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438df800 x1875759226668288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788864006.635613:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788864006.635624:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226668032:0@lo:400:kworker.0 00000100:00100000:0.0:1788864006.635700:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864006.635774:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226668032 00000100:00100000:0.0:1788864006.635781:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226668032 00000100:00100000:0.0:1788864006.635842:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788864006.635851:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:3642:x1875759226668032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864006.635901:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:3642:x1875759226668032:12345-0@lo:400:kworker.0 Request processed in 51us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864006.635909:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788864006.635951:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226668160:0@lo:38:kworker.0 00000100:00100000:0.0:1788864006.635984:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864006.636002:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226668288:0@lo:38:kworker.0 00000100:00100000:0.0:1788864006.636027:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864006.636069:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226668032:0@lo:400:kworker.0 00000100:00100000:3.0:1788864006.636185:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226668288 00000100:00100000:3.0:1788864006.636189:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226668288 00000100:00100000:3.0:1788864006.636219:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788864006.636225:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226668288:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788864006.636247:0:22630:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 673 last 0 00000020:00000080:3.0:1788864006.636288:0:22630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf569beb9d4b6a835 00000004:00100000:3.0:1788864006.636305:0:22630:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788864006.636447:0:22630:0:(import.c:65:import_set_state_nolock()) ffff89e541f54000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788864006.636495:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875759226668288:12345-0@lo:38:kworker.0 Request processed in 269us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864006.636503:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788864006.636545:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e5438df800 x1875759226668288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788864016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788864006.636558:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788864006.636565:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788864006.636569:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788864006.636571:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e541e74000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788864006.636576:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875759226668288:0@lo:38:kworker.0 00000100:00100000:2.0:1788864006.637008:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226668160 00000100:00100000:2.0:1788864006.637013:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226668160 00000100:00100000:2.0:1788864006.637092:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788864006.637098:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875759226668160:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788864006.637112:0:22634:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788864006.637162:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875759226668160:12345-0@lo:38:kworker.0 Request processed in 63us (1177us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788864006.637168:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788864006.637237:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676197800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788864006.637241:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788864006.637245:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226668160:0@lo:38:kworker.0 00000001:02000400:1.0:1788864006.639733:0:22913:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788864006.715984:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788864006.828297:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864007.723856:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788864007.853985:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788864007.961930:0:22965:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788864007.962168:0:22965:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788864008.749085:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788864008.875366:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788864009.173867:0:23015:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788864009.174058:0:23015:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788864009.771669:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788864009.899326:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864010.802439:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788864010.923236:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788864011.755391:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788864011.755397:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788864011.755401:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e676197800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788864011.755410:0:13187:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 673 00000100:00080000:2.0:1788864011.755416:0:13187:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788864011.755427:0:13187:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89e676197800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788864011.755452:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67af57800 x1875759226668544/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788864011.755471:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864011.755475:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788864011.755478:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864011.755480:0:13187:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788864011.755615:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226668416:0@lo:400:kworker.0 00000100:00100000:0.0:1788864011.755685:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864011.755746:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788864011.755752:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226668672:0@lo:400:kworker.0 00000100:00100000:0.0:1788864011.755780:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864011.755827:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226668672 00000100:00100000:0.0:1788864011.755835:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226668672 00000100:00100000:0.0:1788864011.755877:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788864011.755885:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226668672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864011.755950:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226668672:12345-0@lo:400:kworker.0 Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864011.755957:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788864011.755997:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e67af56d80 x1875759226668672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864011.756011:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226668672:0@lo:400:kworker.0 00000100:00100000:2.0:1788864011.756530:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226668416 00000100:00100000:2.0:1788864011.756535:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226668416 00000100:00100000:2.0:1788864011.756575:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788864011.756583:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:3640:x1875759226668416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864011.756624:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:3640:x1875759226668416:12345-0@lo:400:kworker.0 Request processed in 42us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864011.756630:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788864011.758204:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226668416:0@lo:400:kworker.0 00000100:00100000:1.0:1788864011.758357:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864001/real 1788864001] req@ffff89e543925c00 x1875759226665216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864011 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864011.758376:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e543925c00 x1875759226665216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864011 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864011.758396:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864001/real 1788864001] req@ffff89e543925180 x1875759226665088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864011 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864011.758409:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e543925180 x1875759226665088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864011 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864011.758442:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226668544:0@lo:38:kworker.0 00000100:00100000:1.0:1788864011.758507:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788864011.758529:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67c45b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864011.758547:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788864011.758550:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226665216:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788864011.758555:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544177000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864011.758560:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788864011.758562:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226665088:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788864011.758604:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864011.758608:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788864011.758611:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e544177000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788864011.758615:0:13187:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 668 00000100:00080000:1.0:1788864011.758619:0:13187:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788864011.758627:0:13187:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89e544177000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788864011.758652:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544209500 x1875759226668800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788864011.758668:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864011.758671:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788864011.758673:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e67c45b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788864011.758676:0:13187:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 668 00000100:00080000:1.0:1788864011.758678:0:13187:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788864011.758682:0:13187:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e67c45b800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788864011.758694:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544208700 x1875759226668928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788864011.758737:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226668800:0@lo:8:kworker.0 00000400:00000100:1.0:1788864011.758759:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226668800 offset 0 length 520: 4 00000100:00100000:1.0:1788864011.758788:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226668928:0@lo:8:kworker.0 00000400:00000100:1.0:1788864011.758804:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226668928 offset 0 length 520: 4 00000100:00100000:0.0:1788864011.759514:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226668544 00000100:00100000:0.0:1788864011.759529:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226668544 00000100:00100000:0.0:1788864011.759571:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788864011.759578:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226668544:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788864011.759596:0:22633:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788864011.759641:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226668544:12345-0@lo:38:kworker.0 Request processed in 62us (1149us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788864011.759648:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788864011.759750:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676197800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864011.759755:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788864011.759759:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226668544:0@lo:38:kworker.0 00000100:00100000:1.0:1788864011.822600:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:0.0:1788864011.948301:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864012.843343:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788864012.971261:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788864013.739983:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788864013.867191:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788864013.997907:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864014.892968:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788864015.019256:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864015.915591:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788864016.049211:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864016.875656:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226669056:0@lo:400:kworker.0 00000100:00100000:3.0:1788864016.875729:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864016.875922:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226669056 00000100:00100000:1.0:1788864016.875930:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226669056 00000100:00100000:1.0:1788864016.875981:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788864016.875991:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:3642:x1875759226669056:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788864016.878975:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788864016.878987:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788864016.878991:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e676197800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788864016.879000:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:2.0:1788864016.879006:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788864016.879021:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89e676197800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788864016.879066:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67af54000 x1875759226669184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788864016.879106:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864016.879110:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788864016.879113:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864016.879116:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788864016.884779:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:3642:x1875759226669056:12345-0@lo:400:kworker.0 Request processed in 8781us (9041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864016.884794:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788864016.885833:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226669312:0@lo:400:kworker.0 00000100:00100000:2.0:1788864016.885917:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864016.885972:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226669184:0@lo:38:kworker.0 00000100:00100000:2.0:1788864016.886016:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864016.886191:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226669184 00000100:00100000:1.0:1788864016.886200:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226669184 00000100:00100000:1.0:1788864016.886239:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864016.886246:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226669184:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788864016.886268:0:22633:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788864016.886328:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226669184:12345-0@lo:38:kworker.0 Request processed in 81us (311us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788864016.886342:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788864016.886402:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676197800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864016.886407:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788864016.886411:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226669184:0@lo:38:kworker.0 00000100:00100000:0.0:1788864016.886708:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226669312 00000100:00100000:0.0:1788864016.886713:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226669312 00000100:00100000:0.0:1788864016.886748:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864016.886755:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226669312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864016.886817:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226669312:12345-0@lo:400:kworker.0 Request processed in 53us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864016.886824:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788864016.887316:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e67af56d80 x1875759226669312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864016.887329:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226669312:0@lo:400:kworker.0 00000100:00100000:3.0:1788864016.893117:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226669056:0@lo:400:kworker.0 00000100:00100000:0.0:1788864016.939340:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788864017.067582:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788864017.357700:0:23361:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788864017.357703:0:23361:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788864017.357705:0:23361:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788864017.357819:0:23361:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89e54399a800 00000020:01000004:1.0:1788864017.357833:0:23361:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788864017.357854:0:23361:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788864017.357868:0:23361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff89e65862cd40) 00000020:00000080:1.0:1788864017.357888:0:23361:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788864017.495863:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788864017.496767:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788864017.503499:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788864017.504257:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788864017.504833:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788864017.505318:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788864017.506246:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788864017.506546:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788864017.506923:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788864017.507446:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788864017.507807:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788864017.508061:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788864017.508751:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788864017.509069:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788864017.509488:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788864017.509692:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788864017.510009:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788864017.510385:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788864017.510582:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788864017.510908:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788864017.511338:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788864017.511562:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788864017.511853:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788864017.512297:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788864017.512604:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788864017.513661:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788864017.514620:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788864017.515120:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788864017.515614:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788864017.516044:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788864017.516529:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788864017.516850:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788864017.517426:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788864017.517628:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788864017.518475:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788864017.518806:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788864017.519528:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788864017.519809:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788864017.520328:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788864017.520559:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1788864017.520856:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788864017.521345:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788864017.521579:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788864017.521868:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788864017.522396:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788864017.522609:0:23361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1788864017.525415:0:23361:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788864017.525679:0:23361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788864017.525692:0:23361:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788864017.525705:0:23361:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b6a843 00000020:01000004:3.0:1788864017.525712:0:23361:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788864017.525737:0:23361:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788864017.525741:0:23361:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788864017.525747:0:23361:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788864017.525778:0:23361:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788864017.525783:0:23361:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788864017.533821:0:23361:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788864017.533868:0:23361:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.135@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788864017.534025:0:23361:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788864017.534028:0:23361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788864017.534030:0:23361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864017.534031:0:23361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864017.534032:0:23361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864017.534033:0:23361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864017.534035:0:23361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788864017.534037:0:23361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864017.534038:0:23361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788864017.534042:0:23361:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788864017.534044:0:23361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788864017.534045:0:23361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788864017.534047:0:23361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864017.534047:0:23361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864017.534049:0:23361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864017.534050:0:23361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864017.534051:0:23361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788864017.534052:0:23361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864017.534053:0:23361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788864017.534117:0:23361:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788864017.534229:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226669440:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788864017.534319:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864017.534366:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226669440 00000100:00100000:3.0:1788864017.534371:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6488e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1788864017.534385:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226669440 00000100:00100000:0.0:1788864017.534513:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788864017.534524:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:23361:x1875759226669440:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788864017.534564:0:22621:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788864017.534567:0:22621:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788864017.534574:0:22621:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788864017.536308:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:23361:x1875759226669440:12345-0@lo:253:mount.lustre.0 Request processed in 1779us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864017.536320:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788864017.536587:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226669440:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788864017.536603:0:23361:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788864017.536606:0:23361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788864017.536608:0:23361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788864017.536609:0:23361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864017.536610:0:23361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864017.536611:0:23361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864017.536613:0:23361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864017.536614:0:23361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788864017.536616:0:23361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864017.536617:0:23361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788864017.536654:0:23361:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e54399a800 from lustre-MDT0001 10000000:01000000:3.0:1788864017.536685:0:23361:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788864017.536688:0:23361:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788864017.536695:0:23361:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89e66c64b380 local copy 00010000:00010000:3.0:1788864017.536704:0:23361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a740 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864017.536803:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226669568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864017.536836:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.536934:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6496d6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788864017.537482:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226669568 00000100:00100000:2.0:1788864017.537490:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226669568 00000100:00100000:2.0:1788864017.537542:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788864017.537552:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:23361:x1875759226669568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864017.537804:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:23361:x1875759226669568:12345-0@lo:501:mount.lustre.0 Request processed in 254us (966us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788864017.537813:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788864017.537993:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226669568:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788864017.538013:0:23361:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788864017.538034:0:23361:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788864017.538043:0:23361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a740 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.538053:0:23361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a740 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864017.538213:0:23361:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e54399a800 10000000:01000000:3.0:1788864017.538218:0:23361:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788864017.538224:0:23361:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff89e66c64b380 10000000:01000000:3.0:1788864017.538226:0:23361:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788864017.538230:0:23361:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff89e66c64b380 from 1 10000000:01000000:3.0:1788864017.538233:0:23361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788864017.538262:0:23361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167de00/0xf569beb9d4b6a84a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.538343:0:23361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64167de00/0xf569beb9d4b6a84a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.538367:0:23361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64167de00/0xf569beb9d4b6a84a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864017.538396:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226669696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788864017.538430:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.538511:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6496d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1788864017.538546:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226669696 00000100:00100000:0.0:1788864017.538553:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226669696 00000100:00100000:0.0:1788864017.538629:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788864017.538637:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+12:23361:x1875759226669696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864017.538657:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864017.538672:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e54357c800/0xf569beb9d4b6a851 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a84a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.538696:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e54357c800/0xf569beb9d4b6a851 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a84a expref: 13 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.538707:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e54357c800/0xf569beb9d4b6a851 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a84a expref: 13 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.538716:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e54357c800, rc 0) 00000100:00100000:0.0:1788864017.538756:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+13:23361:x1875759226669696:12345-0@lo:101:mount.lustre.0 Request processed in 120us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864017.538763:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788864017.538821:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226669696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864017.538833:0:23361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64167de00/0xf569beb9d4b6a84a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a851 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.538842:0:23361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64167de00/0xf569beb9d4b6a84a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a851 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864017.538857:0:23361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788864017.538882:0:23361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167de00/0xf569beb9d4b6a84a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a851 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.538889:0:23361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64167de00/0xf569beb9d4b6a84a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a851 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864017.538904:0:23361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89e54399a800 10000000:01000000:3.0:1788864017.538908:0:23361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788864017.538912:0:23361:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff89e54399a800 from 1 10000000:01000000:3.0:1788864017.538914:0:23361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788864017.538928:0:23361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167d000/0xf569beb9d4b6a858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.538935:0:23361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64167d000/0xf569beb9d4b6a858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.538950:0:23361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64167d000/0xf569beb9d4b6a858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864017.538965:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226669824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788864017.538992:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.539578:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6496d6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788864017.539610:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226669824 00000100:00100000:1.0:1788864017.539616:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226669824 00000100:00100000:0.0:1788864017.539674:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788864017.539683:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+13:23361:x1875759226669824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864017.539693:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864017.539703:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e54357c200/0xf569beb9d4b6a85f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a858 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.539720:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e54357c200/0xf569beb9d4b6a85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a858 expref: 14 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.539728:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e54357c200/0xf569beb9d4b6a85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a858 expref: 14 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.539747:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e54357c200, rc 0) 00000100:00100000:0.0:1788864017.539791:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+14:23361:x1875759226669824:12345-0@lo:101:mount.lustre.0 Request processed in 109us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864017.539797:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788864017.540057:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226669824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864017.540071:0:23361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64167d000/0xf569beb9d4b6a858 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a85f expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.540111:0:23361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64167d000/0xf569beb9d4b6a858 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a85f expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864017.540200:0:23361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788864017.540209:0:23361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167d000/0xf569beb9d4b6a858 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a85f expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.540216:0:23361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64167d000/0xf569beb9d4b6a858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a85f expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864017.540224:0:23361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788864017.540228:0:23361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788864017.540234:0:23361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89e54399a800 10000000:01000000:3.0:1788864017.540236:0:23361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788864017.540240:0:23361:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788864017.540243:0:23361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788864017.540260:0:23361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167c400/0xf569beb9d4b6a866 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.540282:0:23361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64167c400/0xf569beb9d4b6a866 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.540289:0:23361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64167c400/0xf569beb9d4b6a866 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864017.540305:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226669952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788864017.540333:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.540354:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6496d6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788864017.543836:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226669952 00000100:00100000:2.0:1788864017.543852:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226669952 00000100:00100000:2.0:1788864017.543909:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788864017.543919:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+14:23361:x1875759226669952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788864017.543937:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864017.543956:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e6808bd600/0xf569beb9d4b6a86d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a866 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.543984:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e6808bd600/0xf569beb9d4b6a86d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a866 expref: 15 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.543994:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e6808bd600/0xf569beb9d4b6a86d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a866 expref: 15 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.544003:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bd600, rc 0) 00000100:00100000:2.0:1788864017.544100:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+15:23361:x1875759226669952:12345-0@lo:101:mount.lustre.0 Request processed in 182us (3764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864017.544107:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788864017.544251:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226669952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864017.544270:0:23361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64167c400/0xf569beb9d4b6a866 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a86d expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.544281:0:23361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64167c400/0xf569beb9d4b6a866 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a86d expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788864017.545875:0:23361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1788864017.546464:0:23361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864017.551355:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788864017.551534:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1788864017.551550:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1788864017.551563:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1788864017.551577:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1788864017.551589:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1788864017.551601:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1788864017.551615:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1788864017.551628:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1788864017.551641:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1788864017.551668:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1788864017.551681:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1788864017.551693:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1788864017.551706:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1788864017.551721:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1788864017.551734:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1788864017.551746:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1788864017.551759:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1788864017.551773:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1788864017.551787:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1788864017.551800:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1788864017.551812:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1788864017.551826:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1788864017.551839:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1788864017.551852:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1788864017.551865:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1788864017.551877:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1788864017.551890:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1788864017.551903:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1788864017.551915:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1788864017.551928:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1788864017.551940:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1788864017.551953:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1788864017.551966:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1788864017.551979:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1788864017.551989:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1788864017.552002:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1788864017.552017:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1788864017.552030:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1788864017.552620:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1788864017.552637:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1788864017.552651:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1788864017.552664:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1788864017.552692:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1788864017.552722:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1788864017.552728:0:23361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1788864017.552844:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226670080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864017.552908:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.553017:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e644615480 going to sleep for 11 seconds 00000100:00100000:1.0:1788864017.553302:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226670080 00000100:00100000:1.0:1788864017.553310:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226670080 00000100:00100000:1.0:1788864017.553564:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788864017.553574:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+15:23361:x1875759226670080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864017.553761:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+15:23361:x1875759226670080:12345-0@lo:501:mount.lustre.0 Request processed in 188us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864017.553778:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788864017.553889:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226670080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864017.553943:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226670208:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788864017.553990:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.554025:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e644615480 going to sleep for 11 seconds 00000100:00100000:0.0:1788864017.554557:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226670208 00000100:00100000:0.0:1788864017.554563:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226670208 00000100:00100000:0.0:1788864017.554606:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788864017.554617:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+15:23361:x1875759226670208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788864017.559724:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+15:23361:x1875759226670208:12345-0@lo:503:mount.lustre.0 Request processed in 5101us (5725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864017.559740:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788864017.559773:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226670208:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788864017.560753:0:23361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788864017.560840:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226670336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864017.560903:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.561501:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864017.561563:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226670336 00000100:00100000:1.0:1788864017.561571:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226670336 00000100:00100000:1.0:1788864017.561622:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788864017.561631:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+15:23361:x1875759226670336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788864017.562858:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+15:23361:x1875759226670336:12345-0@lo:502:mount.lustre.0 Request processed in 1222us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864017.562868:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788864017.562946:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226670336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788864017.563725:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788864017.563761:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1788864017.563773:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1788864017.563786:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1788864017.563799:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1788864017.563810:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1788864017.563822:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1788864017.563834:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1788864017.563847:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1788864017.563858:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1788864017.563870:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1788864017.563894:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1788864017.563907:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1788864017.563919:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1788864017.563931:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1788864017.563943:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1788864017.563958:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1788864017.563969:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1788864017.563981:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1788864017.563992:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1788864017.564004:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1788864017.564016:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1788864017.564032:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1788864017.564241:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1788864017.564263:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1788864017.564274:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1788864017.564285:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1788864017.564296:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1788864017.564307:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1788864017.564318:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1788864017.564330:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1788864017.564343:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1788864017.564356:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1788864017.564367:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1788864017.564391:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1788864017.564405:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1788864017.564417:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1788864017.564430:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1788864017.564441:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1788864017.564453:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1788864017.564464:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1788864017.564476:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1788864017.564487:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1788864017.564501:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1788864017.564545:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226670464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864017.564605:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.564779:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864017.564823:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226670464 00000100:00100000:1.0:1788864017.564835:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226670464 00000100:00100000:1.0:1788864017.564912:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788864017.564920:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+15:23361:x1875759226670464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788864017.565054:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+15:23361:x1875759226670464:12345-0@lo:502:mount.lustre.0 Request processed in 134us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864017.565061:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788864017.565295:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226670464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788864017.565353:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1788864017.565364:0:23361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788864017.566064:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864017.566100:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.566103:0:23366:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788864017.566110:0:23366:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788864017.566113:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788864017.566202:0:23366:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff89e542b6cd40) 00000020:00000080:2.0:1788864017.566225:0:23366:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788864017.566232:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788864017.566309:0:23366:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788864017.566316:0:23366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b6a87b 00000020:00000080:2.0:1788864017.566522:0:23366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788864017.566527:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864017.566530:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.566532:0:23366:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788864017.566535:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864017.566538:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.566540:0:23366:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788864017.566543:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788864017.566550:0:23366:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff89e542b6b380) 00000020:00000080:2.0:1788864017.566560:0:23366:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788864017.566564:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788864017.566566:0:23366:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788864017.566569:0:23366:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788864017.566575:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788864017.566621:0:23366:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e54399a800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788864017.566633:0:23366:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff89e542b68000) 00000020:00000080:2.0:1788864017.566716:0:23366:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788864017.566794:0:23366:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788864017.566800:0:23366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b6a890 00000020:00000080:2.0:1788864017.566898:0:23366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788864017.566905:0:23366:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788864017.566910:0:23366:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf569beb9d4b6a897 00080000:01000000:2.0:1788864017.566916:0:23366:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788864017.566919:0:23366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b6a89e 00010000:00010000:3.0:1788864017.661029:0:23366:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788864017.661582:0:23366:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1788864017.662292:0:23366:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788864017.663468:0:23366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788864017.663488:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864017.663496:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.663499:0:23366:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788864017.663502:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864017.663508:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.663510:0:23366:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788864017.663513:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788864017.663519:0:23366:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:00000080:2.0:1788864017.663547:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788864017.663562:0:23366:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff89e542b699c0) 00000020:00000080:2.0:1788864017.663584:0:23366:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788864017.663589:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788864017.663667:0:23366:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788864017.663674:0:23366:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788864017.663681:0:23366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b6a8ac 00010000:00080000:2.0:1788864017.663717:0:23366:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e543a47800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788864017.667116:0:23366:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788864017.668340:0:23366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788864017.668356:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788864017.668411:0:23366:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788864017.668435:0:23366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b6a8b3 00000100:00080000:2.0:1788864017.668446:0:23366:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788864017.668458:0:23366:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff89e543a47800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788864017.668495:0:23366:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67af56d80 x1875759226670592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788864017.668575:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226670592:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788864017.668673:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864017.668772:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226670592 00000100:00100000:0.0:1788864017.668780:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226670592 00000100:00100000:0.0:1788864017.668818:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788864017.668826:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875759226670592:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788864017.668850:0:22633:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:0.0:1788864017.668882:0:22633:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b6a8ba 00000004:00100000:0.0:1788864017.668897:0:22633:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788864017.668903:0:22633:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:2.0:1788864017.669014:0:23366:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788864017.669106:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864017.669112:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.669114:0:23366:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788864017.669117:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788864017.669121:0:23366:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788864017.669129:0:23366:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788864017.669131:0:23366:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788864017.669133:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788864017.669136:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.669137:0:23366:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788864017.669140:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864017.669145:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.669146:0:23366:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788864017.669150:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788864017.669185:0:23366:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788864017.669198:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864017.669201:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.669202:0:23366:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788864017.669205:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788864017.669207:0:23366:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788864017.669208:0:23366:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788864017.669209:0:23366:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788864017.669211:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788864017.669213:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.669215:0:23366:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788864017.669217:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788864017.669220:0:23366:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788864017.669224:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.669225:0:23366:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788864017.669228:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788864017.669231:0:23366:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:2.0:1788864017.669251:0:23366:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788864017.669253:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00080000:0.0:1788864017.669310:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788864017.669315:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788864017.669318:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e676197800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788864017.669323:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 683 00000100:00080000:0.0:1788864017.669326:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788864017.669339:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89e676197800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788864017.669357:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438ddc00 x1875759226670720/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788864017.669425:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226670720:0@lo:38:kworker.0 00000020:00000080:2.0:1788864017.669438:0:23366:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff89e5428e99c0) 00000020:00000080:2.0:1788864017.669454:0:23366:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788864017.669463:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1788864017.669468:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864017.669502:0:22634:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788864017.669509:0:22634:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00080000:2.0:1788864017.669567:0:23366:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788864017.669580:0:23366:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788864017.669587:0:23366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b6a8c8 00010000:00080000:2.0:1788864017.669616:0:23366:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e67c44e000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788864017.669854:0:23366:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1788864017.670255:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864017.670260:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788864017.670263:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864017.670266:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788864017.670531:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226670720 00000100:00100000:3.0:1788864017.670539:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226670720 00000100:00100000:0.0:1788864017.670726:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788864017.670741:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1875759226670720:12345-0@lo:38:kworker.0 00000040:01000000:2.0:1788864017.670869:0:23366:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788864017.671051:0:23366:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788864017.672135:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1875759226670720:12345-0@lo:38:kworker.0 Request processed in 1395us (2664us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788864017.672146:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788864017.672289:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788864017.672298:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676197800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788864017.672303:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788864017.672307:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226670720:0@lo:38:kworker.0 00000040:00080000:2.0:1788864017.672639:0:23366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788864017.672862:0:23366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788864017.673002:0:23366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:1.0:1788864017.675704:0:22633:0:(import.c:65:import_set_state_nolock()) ffff89e64673d000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1788864017.675805:0:23372:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788864017.675812:0:23372:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788864017.676015:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875759226670592:12345-0@lo:38:llog_process_th.0 Request processed in 7185us (7339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864017.676028:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788864017.676134:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788864017.676145:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788864017.676153:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788864017.676158:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788864017.676161:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e543a47800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788864017.676170:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226670592:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788864017.676287:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788864017.676301:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226670848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788864017.676343:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864017.676396:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226670848 00000100:00100000:2.0:1788864017.676403:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226670848 00000100:00100000:2.0:1788864017.676453:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788864017.676464:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875759226670848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788864017.676493:0:22634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788864017.676549:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875759226670848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864017.676557:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788864017.676576:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226670848:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1788864017.676616:0:23366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788864017.676632:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788864017.676670:0:23366:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788864017.676689:0:23366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b6a8cf 00000100:00080000:3.0:1788864017.676700:0:23366:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788864017.676708:0:23366:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89e67c44e000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788864017.676729:0:23366:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543926680 x1875759226670976/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788864017.676779:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226670976:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788864017.676806:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226670976 offset 0 length 520: 4 00000100:00080000:3.0:1788864017.676853:0:23366:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788864017.676919:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788864017.676923:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864017.676925:0:23366:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788864017.676928:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788864017.676930:0:23366:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788864017.676932:0:23366:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788864017.676933:0:23366:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788864017.676935:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788864017.676937:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864017.676938:0:23366:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788864017.676941:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788864017.676945:0:23366:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788864017.676949:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788864017.676950:0:23366:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788864017.676953:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788864017.676956:0:23366:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:3.0:1788864017.676979:0:23366:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788864017.676981:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788864017.676995:0:23366:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff89e65d58cd40) 00000020:00000080:3.0:1788864017.677008:0:23366:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788864017.677013:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:0.0:1788864017.677066:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864017.677071:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788864017.677103:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864017.677106:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:3.0:1788864017.677128:0:23366:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788864017.677135:0:23366:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788864017.677141:0:23366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf569beb9d4b6a8dd 00010000:00080000:3.0:1788864017.677169:0:23366:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e544143000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.135@tcp at head 00010000:00010000:2.0:1788864017.677455:0:23366:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788864017.677520:0:23366:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788864017.677536:0:23366:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788864017.679253:0:23366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788864017.679527:0:23366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788864017.679650:0:23366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788864017.680269:0:23374:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788864017.680275:0:23374:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788864017.681069:0:23366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788864017.681194:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788864017.681238:0:23366:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788864017.681273:0:23366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b6a8e4 00000100:00080000:2.0:1788864017.681284:0:23366:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788864017.681297:0:23366:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e544143000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788864017.681338:0:23366:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67af54e00 x1875759226671104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788864017.681411:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226671104:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788864017.681481:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226671104 offset 0 length 520: 4 00000100:00080000:2.0:1788864017.681555:0:23366:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788864017.681617:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864017.681622:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.681623:0:23366:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788864017.681626:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864017.681630:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.681631:0:23366:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788864017.681633:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788864017.681635:0:23366:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788864017.681637:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864017.681639:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.681640:0:23366:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788864017.681642:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864017.681644:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.681645:0:23366:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788864017.681649:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788864017.681676:0:23366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864017.681679:0:23366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.681680:0:23366:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788864017.681683:0:23366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1788864017.681742:0:23361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788864017.681772:0:23361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788864017.681788:0:23361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167c400/0xf569beb9d4b6a866 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a86d expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.681799:0:23361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64167c400/0xf569beb9d4b6a866 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a86d expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864017.681818:0:23361:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e54399a800 from 1 10000000:01000000:2.0:1788864017.681821:0:23361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788864017.681846:0:23361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.681854:0:23361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.681865:0:23361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864017.681881:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226671232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788864017.681932:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864017.681953:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808ef900 going to sleep for 11 seconds 00000100:00100000:2.0:1788864017.682353:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226671232 00000100:00100000:2.0:1788864017.682360:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226671232 00000100:00100000:2.0:1788864017.682415:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788864017.682425:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+15:23361:x1875759226671232:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788864017.682438:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864017.682450:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a8f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a8eb expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.682474:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a8f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a8eb expref: 16 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.682485:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a8f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a8eb expref: 16 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.682507:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bc600, rc 0) 00000100:00100000:2.0:1788864017.682562:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+16:23361:x1875759226671232:12345-0@lo:101:mount.lustre.0 Request processed in 138us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864017.682570:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788864017.682626:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226671232:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788864017.682642:0:23361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a8f2 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.682652:0:23361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a8f2 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788864017.682886:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788864017.683053:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788864017.683057:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788864017.683060:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788864017.683339:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226671360:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788864017.683398:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864017.683478:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808ef900 going to sleep for 11 seconds 00000100:00100000:1.0:1788864017.683515:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226671360 00000100:00100000:1.0:1788864017.683520:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226671360 00000100:00100000:1.0:1788864017.683556:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788864017.683565:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+16:23361:x1875759226671360:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788864017.683589:0:22621:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788864017.683604:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788864017.683607:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788864017.683698:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+16:23361:x1875759226671360:12345-0@lo:256:mount.lustre.0 Request processed in 135us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864017.683706:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788864017.683755:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226671360:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788864017.684357:0:23361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788864017.684391:0:23361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a8f2 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.684403:0:23361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a8f2 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864017.684411:0:23361:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e54399a800 from 1 10000000:01000000:3.0:1788864017.684414:0:23361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788864017.684439:0:23361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.684446:0:23361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.684454:0:23361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864017.684470:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226671488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788864017.684505:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.684541:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6488e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1788864017.684770:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226671488 00000100:00100000:0.0:1788864017.684776:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226671488 00000100:00100000:0.0:1788864017.684814:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788864017.684821:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+16:23361:x1875759226671488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864017.684831:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864017.684842:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e54357de00/0xf569beb9d4b6a900 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a8f9 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.684861:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e54357de00/0xf569beb9d4b6a900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a8f9 expref: 17 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.684883:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e54357de00/0xf569beb9d4b6a900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a8f9 expref: 17 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.684998:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e54357de00, rc 0) 00000100:00100000:0.0:1788864017.685045:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:23361:x1875759226671488:12345-0@lo:101:mount.lustre.0 Request processed in 224us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864017.685053:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788864017.685165:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226671488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864017.685179:0:23361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a900 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.685195:0:23361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a900 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788864017.686738:0:23361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788864017.687215:0:23361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788864017.687422:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788864017.687449:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788864017.687463:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788864017.687477:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788864017.687491:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788864017.687504:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788864017.687519:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788864017.687532:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788864017.687546:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788864017.687558:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788864017.687571:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788864017.687589:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788864017.687594:0:23361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788864017.687676:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226671616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864017.687737:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864017.687782:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808ef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864017.687860:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226671616 00000100:00100000:1.0:1788864017.687867:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226671616 00000100:00100000:1.0:1788864017.687928:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788864017.687938:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:23361:x1875759226671616:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864017.688052:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:23361:x1875759226671616:12345-0@lo:501:mount.lustre.0 Request processed in 116us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864017.688060:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788864017.688467:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226671616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864017.688505:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226671744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788864017.688552:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864017.688626:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808ef9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864017.688661:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226671744 00000100:00100000:0.0:1788864017.688666:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226671744 00000100:00100000:0.0:1788864017.688737:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788864017.688746:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:23361:x1875759226671744:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788864017.688841:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:23361:x1875759226671744:12345-0@lo:503:mount.lustre.0 Request processed in 96us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864017.688848:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788864017.688916:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226671744:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788864017.689344:0:23361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788864017.689423:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226671872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864017.689463:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864017.689680:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226671872 00000100:00100000:1.0:1788864017.689687:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226671872 00000100:00100000:2.0:1788864017.689710:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808ef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864017.689724:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788864017.689733:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:23361:x1875759226671872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788864017.689837:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:23361:x1875759226671872:12345-0@lo:502:mount.lustre.0 Request processed in 105us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864017.689846:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788864017.689867:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226671872:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788864017.690262:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788864017.690303:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788864017.690492:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788864017.690514:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788864017.690532:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788864017.690548:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788864017.690565:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788864017.690580:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788864017.690594:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788864017.690607:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788864017.690619:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788864017.690661:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864017.691825:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864017.691879:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808ef9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864017.692200:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226672000 00000100:00100000:0.0:1788864017.692210:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226672000 00000100:00100000:0.0:1788864017.692268:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788864017.692277:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:23361:x1875759226672000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788864017.692439:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:23361:x1875759226672000:12345-0@lo:502:mount.lustre.0 Request processed in 162us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864017.692449:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788864017.692475:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788864017.692559:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788864017.692571:0:23361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788864017.694538:0:23376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864017.694551:0:23376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.694553:0:23376:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788864017.694561:0:23376:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e54399a800 00000020:00000080:2.0:1788864017.694564:0:23376:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788864017.694572:0:23376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864017.694574:0:23376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.694576:0:23376:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788864017.694578:0:23376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864017.694581:0:23376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.694582:0:23376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788864017.694585:0:23376:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e54399a800 00000020:00000080:2.0:1788864017.694587:0:23376:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788864017.695461:0:23376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864017.695469:0:23376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.695470:0:23376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788864017.695473:0:23376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864017.695476:0:23376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.695477:0:23376:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788864017.695481:0:23376:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e54399a800 00000020:00000080:2.0:1788864017.695483:0:23376:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788864017.695509:0:23376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864017.695511:0:23376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.695513:0:23376:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788864017.695515:0:23376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864017.695517:0:23376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.695518:0:23376:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788864017.695521:0:23376:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e54399a800 00000020:00000080:2.0:1788864017.695523:0:23376:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788864017.695562:0:23376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864017.695565:0:23376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864017.695566:0:23376:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788864017.695570:0:23376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1788864017.700394:0:23361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788864017.700447:0:23361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788864017.700477:0:23361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a900 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.700507:0:23361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a900 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864017.702531:0:23361:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788864017.702538:0:23361:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e54399a800 10000000:01000000:0.0:1788864017.702542:0:23361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e54399a800 10000000:01000000:0.0:1788864017.702547:0:23361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788864017.702554:0:23361:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e54399a800 from 1 10000000:01000000:0.0:1788864017.702557:0:23361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788864017.702598:0:23361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357da00/0xf569beb9d4b6a907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.703024:0:23361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e54357da00/0xf569beb9d4b6a907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.703040:0:23361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e54357da00/0xf569beb9d4b6a907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864017.703066:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788864017.703794:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864017.704419:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e659945cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864017.704832:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226672128 00000100:00100000:2.0:1788864017.704842:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226672128 00000100:00100000:2.0:1788864017.704904:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788864017.704913:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:23361:x1875759226672128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788864017.704930:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864017.705151:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e6808bce00/0xf569beb9d4b6a90e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a907 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.705181:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e6808bce00/0xf569beb9d4b6a90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a907 expref: 18 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.705193:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e6808bce00/0xf569beb9d4b6a90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a907 expref: 18 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.705202:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bce00, rc 0) 00000100:00100000:2.0:1788864017.705306:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:23361:x1875759226672128:12345-0@lo:101:mount.lustre.0 Request processed in 393us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864017.705313:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788864017.705401:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788864017.705418:0:23361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e54357da00/0xf569beb9d4b6a907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a90e expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.705428:0:23361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e54357da00/0xf569beb9d4b6a907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a90e expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788864017.708508:0:23361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1788864017.709459:0:23361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864017.710766:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788864017.710811:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1788864017.710831:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1788864017.710849:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1788864017.710866:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1788864017.710883:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1788864017.711244:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1788864017.711408:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1788864017.711428:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1788864017.711441:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1788864017.711452:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1788864017.711465:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1788864017.711491:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1788864017.711507:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1788864017.711523:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788864017.711751:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788864017.711775:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788864017.711791:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788864017.711805:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788864017.711819:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788864017.711834:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788864017.711851:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788864017.711882:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788864017.712431:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788864017.712462:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788864017.712479:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788864017.712495:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788864017.712510:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788864017.712526:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788864017.712542:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788864017.712556:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788864017.712572:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788864017.712585:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788864017.712601:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788864017.712616:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788864017.712633:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788864017.713784:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788864017.713813:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788864017.713848:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788864017.713866:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788864017.713880:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788864017.714258:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788864017.714534:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788864017.714550:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788864017.714564:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788864017.714577:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788864017.714592:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788864017.714606:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788864017.715181:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788864017.715220:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788864017.715246:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788864017.715252:0:23361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788864017.715414:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864017.715487:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864017.715538:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808eff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788864017.717000:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226672256 00000100:00100000:3.0:1788864017.717012:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226672256 00000100:00100000:3.0:1788864017.717068:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788864017.717095:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:23361:x1875759226672256:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864017.717272:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:23361:x1875759226672256:12345-0@lo:501:mount.lustre.0 Request processed in 196us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864017.717290:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788864017.717433:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864017.717490:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788864017.717536:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864017.717565:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226672384 00000100:00100000:2.0:1788864017.717575:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226672384 00000100:00100000:3.0:1788864017.717577:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647ff5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788864017.717605:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788864017.717612:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:23361:x1875759226672384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788864017.717690:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:23361:x1875759226672384:12345-0@lo:503:mount.lustre.0 Request processed in 78us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864017.718589:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788864017.718643:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000040:00080000:2.0:1788864017.719927:0:23361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788864017.720036:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864017.720138:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864017.720183:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808efc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788864017.720323:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226672512 00000100:00100000:0.0:1788864017.720330:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226672512 00000100:00100000:0.0:1788864017.720392:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788864017.720403:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:23361:x1875759226672512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788864017.720516:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:23361:x1875759226672512:12345-0@lo:502:mount.lustre.0 Request processed in 115us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864017.720523:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788864017.720675:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788864017.720862:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788864017.720890:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788864017.720903:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788864017.720917:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788864017.720928:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788864017.720939:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788864017.720951:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788864017.721034:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788864017.721055:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788864017.721071:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788864017.721194:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788864017.721208:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788864017.721220:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788864017.721247:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788864017.721381:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788864017.721404:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788864017.721419:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788864017.721433:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788864017.721463:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788864017.721478:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788864017.721497:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788864017.721513:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788864017.721528:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788864017.721545:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788864017.721561:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788864017.721574:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788864017.721591:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788864017.721607:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788864017.721627:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788864017.721655:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788864017.721671:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788864017.721684:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788864017.721697:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788864017.721710:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788864017.721726:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788864017.721742:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788864017.721758:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788864017.721773:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788864017.721788:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788864017.721805:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788864017.721821:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788864017.721837:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788864017.721852:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788864017.721870:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788864017.721885:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788864017.721911:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788864017.721926:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788864017.721939:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788864017.722066:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864017.722192:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864017.722237:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808efc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788864017.722386:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226672640 00000100:00100000:3.0:1788864017.722394:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226672640 00000100:00100000:3.0:1788864017.722438:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788864017.722447:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:23361:x1875759226672640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864017.722557:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:23361:x1875759226672640:12345-0@lo:502:mount.lustre.0 Request processed in 111us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864017.722565:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788864017.722588:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788864017.722752:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788864017.722776:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788864017.722802:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864017.722841:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864017.722865:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808efc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788864017.722910:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226672768 00000100:00100000:0.0:1788864017.722915:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226672768 00000100:00100000:0.0:1788864017.722949:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788864017.722957:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:23361:x1875759226672768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788864017.723168:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:23361:x1875759226672768:12345-0@lo:502:mount.lustre.0 Request processed in 212us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864017.723176:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788864017.723370:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226672768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788864017.723430:0:23361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1788864017.723439:0:23361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788864017.724826:0:23381:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788864017.724842:0:23381:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff89e681bfb380) 00000020:00000080:3.0:1788864017.724866:0:23381:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788864017.725634:0:23381:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e54399a800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788864017.726020:0:23381:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e54399a800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788864017.726024:0:23381:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e54399a800 3 00010000:00080000:3.0:1788864017.726059:0:23381:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e659e55800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.135@tcp at head 00010000:00010000:3.0:1788864017.728236:0:23381:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788864017.728450:0:23381:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788864017.728493:0:23381:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788864017.728507:0:23381:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf569beb9d4b6a91c 00000100:00080000:3.0:1788864017.728517:0:23381:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788864017.728534:0:23381:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff89e659e55800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788864017.728574:0:23381:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543926d80 x1875759226672896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788864017.728607:0:23381:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788864017.728636:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788864017.728640:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788864017.728644:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788864017.728647:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788864017.729115:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226672896:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788864017.729182:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788864017.729434:0:23381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:0.0:1788864017.729911:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226672896 00000100:00100000:0.0:1788864017.729920:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226672896 00000100:00100000:0.0:1788864017.729956:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788864017.729964:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226672896:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788864017.729991:0:22630:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:0.0:1788864017.730029:0:22630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf569beb9d4b6a923 00000004:00100000:0.0:1788864017.730045:0:22630:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788864017.730113:0:22630:0:(import.c:65:import_set_state_nolock()) ffff89e680c20800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788864017.730189:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875759226672896:12345-0@lo:38:llog_process_th.0 Request processed in 223us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864017.730197:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788864017.731582:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e543926d80 x1875759226672896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788864027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864017.731597:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788864017.731609:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788864017.731618:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788864017.731624:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788864017.731627:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e659e55800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788864017.731635:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875759226672896:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788864017.731928:0:23361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788864017.733497:0:23361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788864017.733523:0:23361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357da00/0xf569beb9d4b6a907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a90e expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.733536:0:23361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e54357da00/0xf569beb9d4b6a907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a90e expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788864017.733625:0:23361:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788864017.733628:0:23361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788864017.733630:0:23361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864017.733632:0:23361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788864017.733634:0:23361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864017.733635:0:23361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864017.733637:0:23361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788864017.733639:0:23361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864017.733640:0:23361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788864017.733644:0:23361:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788864017.733646:0:23361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788864017.733647:0:23361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788864017.733648:0:23361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864017.733650:0:23361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788864017.733651:0:23361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864017.733652:0:23361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864017.733653:0:23361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788864017.733654:0:23361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864017.733655:0:23361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788864017.733686:0:23361:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788864017.733705:0:23361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226673024:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788864017.733770:0:23361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864017.733811:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226673024 00000100:00100000:2.0:1788864017.733817:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226673024 00000100:00100000:2.0:1788864017.733863:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788864017.733871:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:23361:x1875759226673024:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788864017.733897:0:22622:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788864017.733912:0:22622:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788864017.734056:0:23361:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6808ef180 going to sleep for 11 seconds 00000001:00100000:0.0:1788864017.744201:0:22608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788864017.746284:0:22622:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788864017.746309:0:22622:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788864017.746467:0:22644:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788864017.746472:0:22644:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788864017.746494:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.746515:0:22644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64167dc00/0xf569beb9d4b6a82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a827 expref: 18 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.746523:0:22644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a8f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a8eb expref: 18 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.746531:0:22644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.746573:0:22644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a8f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a8eb expref: 18 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.746586:0:22644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a8f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a8eb expref: 18 pid: 22622 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864017.746600:0:22644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226673152:0@lo:104: 00000100:00100000:0.0:1788864017.746673:0:22644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788864017.746729:0:22644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64167dc00/0xf569beb9d4b6a82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a827 expref: 18 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.746737:0:22644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e64167dc00/0xf569beb9d4b6a82e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a827 expref: 18 pid: 22623 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864017.746744:0:22644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226673280:0@lo:104: 00000100:00100000:0.0:1788864017.746772:0:22644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864017.746794:0:22644:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6599453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864017.746907:0:22612:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226673152 00000100:00100000:2.0:1788864017.746914:0:22612:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226673152 00000100:00100000:2.0:1788864017.746943:0:22612:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226673280 00000100:00100000:2.0:1788864017.746945:0:22612:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226673280 00000100:00100000:2.0:1788864017.746959:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788864017.746967:0:22612:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+4:22644:x1875759226673152:12345-0@lo:104: 00010000:00010000:2.0:1788864017.746979:0:22612:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a8f2 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.747042:0:22612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788864017.747049:0:22612:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+4:22644:x1875759226673152:12345-0@lo:104: Request processed in 83us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864017.747057:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788864017.747058:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864017.747066:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a8f2 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864017.747106:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788864017.747116:0:22612:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:22644:x1875759226673280:12345-0@lo:104: 00010000:00010000:2.0:1788864017.747124:0:22612:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a82e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.747141:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bc000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788864017.747147:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a8f2 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.747157:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a8f2 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788864017.747166:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a8f2 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864017.747172:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788864017.747183:0:22612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788864017.747190:0:22612:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:22644:x1875759226673280:12345-0@lo:104: Request processed in 77us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864017.747197:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788864017.747197:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864017.747205:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a8f2 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.747214:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788864017.747249:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a8f2 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.747257:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e6808bc000/0xf569beb9d4b6a8eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a8f2 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.747270:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864017.747272:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864017.747274:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864017.747292:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226673408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788864017.747325:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.747365:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226673408 00000100:00100000:3.0:1788864017.747370:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226673408 00010000:00010000:3.0:1788864017.747399:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a8f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a8eb expref: 19 pid: 22622 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864017.747422:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788864017.747429:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:3641:x1875759226673408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864017.747440:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864017.747445:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a8f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a8eb expref: 19 pid: 22622 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.747456:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a8f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a8eb expref: 19 pid: 22622 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864017.747470:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864017.747502:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:3641:x1875759226673408:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864017.747509:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788864017.747550:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226673408:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788864017.747897:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e6808bc600/0xf569beb9d4b6a8f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a8eb expref: 18 pid: 22622 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864017.747907:0:22644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226673152:0@lo:104: 00000100:00100000:0.0:1788864017.747914:0:22644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226673280:0@lo:104: 00010000:00010000:0.0:1788864017.747928:0:22644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864017.748458:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864017.748462:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864017.748464:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864017.748576:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:23361:x1875759226673024:12345-0@lo:253:mount.lustre.0 Request processed in 14704us (14803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864017.748585:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788864017.748714:0:23361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:23361:1875759226673024:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1788864017.748723:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a82e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864017.748726:0:23361:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788864017.748731:0:23361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788864017.748735:0:23361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00010000:00010000:1.0:1788864017.748737:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030000 already unused, calling callback (ffffffffc147ac20) 00000020:01000004:2.0:1788864017.748738:0:23361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864017.748741:0:23361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 10000000:00010000:1.0:1788864017.748742:0:22617:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a82e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788864017.748744:0:23361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864017.748747:0:23361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864017.748750:0:23361:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788864017.748753:0:23361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864017.748756:0:23361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1788864017.748756:0:22617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a82e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788864017.748765:0:22617:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a82e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1788864017.748770:0:23361:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 10000000:01000000:1.0:1788864017.748771:0:22617:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788864017.748805:0:22617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a82e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.748810:0:22617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788864017.748837:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a82e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.748844:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640030000/0xf569beb9d4b6a827 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a82e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.748859:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864017.748867:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864017.748869:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864017.748882:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864017.748894:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3643:1875759226673536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864017.749213:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864017.749266:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226673536 00000100:00100000:1.0:1788864017.749273:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226673536 00010000:00010000:1.0:1788864017.749306:0:22615:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64167dc00/0xf569beb9d4b6a82e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a827 expref: 17 pid: 22623 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864017.749331:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788864017.749339:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:3643:x1875759226673536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788864017.749350:0:22615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864017.749355:0:22615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64167dc00/0xf569beb9d4b6a82e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a827 expref: 17 pid: 22623 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.749366:0:22615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64167dc00/0xf569beb9d4b6a82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a827 expref: 17 pid: 22623 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.749389:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167dc00/0xf569beb9d4b6a82e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a827 expref: 17 pid: 22623 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.749402:0:22615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.749410:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788864017.749425:0:22615:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002953889s 00010000:00010000:1.0:1788864017.749431:0:22615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.749449:0:22615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.749456:0:22615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.749464:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.749470:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e54357d200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864017.749474:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.749483:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.756451:0:22644:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864017.756469:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.756709:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.756723:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e54357d200/0xf569beb9d4b6a92a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864017.756746:0:22615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864017.756846:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+16:3643:x1875759226673536:12345-0@lo:103:ldlm_bl.0 Request processed in 7504us (7630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864017.756858:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788864017.757801:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3643:1875759226673536:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1788864017.759665:0:23361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788864017.760135:0:23388:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000040:01000000:3.0:1788864017.760139:0:23389:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000020:00080000:1.0:1788864017.760140:0:23388:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788864017.760196:0:23361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1788864017.761054:0:23389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864017.763651:0:23389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788864017.763726:0:23389:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1788864017.769616:0:23361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788864017.769673:0:23361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788864017.770157:0:23361:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788864017.770185:0:23361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788864017.771064:0:23361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788864017.771779:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23390:1875759226673664:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788864017.771842:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.771882:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64a8ce000 going to sleep for 11 seconds 00000100:00100000:2.0:1788864017.772032:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226673664 00000100:00100000:2.0:1788864017.772039:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226673664 00000100:00100000:2.0:1788864017.772116:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788864017.772125:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23390:x1875759226673664:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788864017.772208:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23390:x1875759226673664:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 84us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864017.772216:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788864017.772296:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23390:1875759226673664:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788864017.772324:0:23390:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788864017.772348:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23390:1875759226673792:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788864017.772389:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.772411:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64a8cea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788864017.772451:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226673792 00000100:00100000:2.0:1788864017.772455:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226673792 00000100:00100000:2.0:1788864017.772487:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788864017.772501:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23390:x1875759226673792:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788864017.772596:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23390:x1875759226673792:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 95us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864017.772602:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788864017.772663:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23390:1875759226673792:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788864017.772713:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23390:1875759226673920:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788864017.772741:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.772758:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647ff5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788864017.773202:0:22639:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226673920 00000100:00100000:2.0:1788864017.773208:0:22639:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226673920 00000100:00100000:2.0:1788864017.773242:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1788864017.773248:0:23361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1788864017.773250:0:22639:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23390:x1875759226673920:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788864017.773302:0:22639:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23390:x1875759226673920:12345-0@lo:900:lod0001_rec0000.0 Request processed in 53us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864017.773309:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788864017.773382:0:23390:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e543927100 x1875759226673920/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788864033 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864017.773394:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23390:1875759226673920:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788864017.773436:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23390:1875759226674048:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788864017.773463:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864017.773485:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64a8ce000 going to sleep for 11 seconds 00000100:00100000:2.0:1788864017.773525:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226674048 00000100:00100000:2.0:1788864017.773530:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226674048 00000100:00100000:2.0:1788864017.773558:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788864017.773564:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23390:x1875759226674048:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788864017.773616:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23390:x1875759226674048:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 52us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864017.773623:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788864017.773680:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23390:1875759226674048:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788864017.773725:0:23390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864017.776888:0:23390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788864017.777820:0:23390:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788864017.777824:0:23361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000004:00080000:3.0:1788864017.777828:0:23390:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:01000000:0.0:1788864017.777907:0:23361:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788864017.778163:0:23361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788864017.778746:0:23361:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:0.0:1788864017.784612:0:23361:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788864017.804746:0:23361:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788864017.804791:0:23361:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa4a9c1c6f988 00100000:10000000:0.0:1788864017.804801:0:23361:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788864017.811177:0:23361:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788864017.811215:0:23361:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788864017.811234:0:23361:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788864017.811271:0:23361:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788864017.812171:0:23361:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788864017.812414:0:23361:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788864017.976893:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788864018.092233:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788864018.800254:0:23385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788864018.992892:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788864019.117946:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788864019.691208:0:22625:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788864019.691217:0:22625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e54399a800 from 12 10000000:01000000:1.0:1788864019.691223:0:22625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788864019.691287:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864019.691300:0:22625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864019.691311:0:22625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864019.691351:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226674176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788864019.691417:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864019.691469:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e649bde180 going to sleep for 11 seconds 00000100:00100000:0.0:1788864019.691667:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226674176 00000100:00100000:0.0:1788864019.691675:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226674176 00000100:00100000:0.0:1788864019.691811:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788864019.691821:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+16:22625:x1875759226674176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864019.691837:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864019.691851:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e54357c400/0xf569beb9d4b6a938 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a931 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864019.691873:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e54357c400/0xf569beb9d4b6a938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a931 expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864019.691884:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e54357c400/0xf569beb9d4b6a938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a931 expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864019.691892:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e54357c400, rc 0) 00000100:00100000:0.0:1788864019.691938:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:22625:x1875759226674176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864019.691944:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788864019.692016:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226674176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864019.692029:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a938 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864019.692038:0:22625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a938 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864019.692128:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226674304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788864019.692168:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864019.692511:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e649bde180 going to sleep for 11 seconds 00000100:00100000:2.0:1788864019.692607:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226674304 00000100:00100000:2.0:1788864019.692613:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226674304 00000100:00100000:2.0:1788864019.692639:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788864019.692646:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:22625:x1875759226674304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788864019.692661:0:22623:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788864019.692678:0:22623:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788864019.692694:0:22623:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788864019.692789:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:22625:x1875759226674304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864019.692801:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788864019.692943:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226674304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788864019.692998:0:22625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788864019.693006:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a938 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864019.693014:0:22625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a938 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864019.693023:0:22625:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788864019.693025:0:22625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e680890800 from 12 10000000:01000000:1.0:1788864019.693027:0:22625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788864019.693049:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864019.693055:0:22625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864019.693063:0:22625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864019.693105:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226674432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788864019.693134:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864019.693161:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e649bde180 going to sleep for 11 seconds 00000100:00100000:2.0:1788864019.693317:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226674432 00000100:00100000:2.0:1788864019.693323:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226674432 00000100:00100000:2.0:1788864019.693364:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788864019.693371:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:22625:x1875759226674432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864019.693381:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864019.693391:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e6808bca00/0xf569beb9d4b6a946 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a93f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864019.693409:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e6808bca00/0xf569beb9d4b6a946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a93f expref: 18 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864019.693418:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e6808bca00/0xf569beb9d4b6a946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a93f expref: 18 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864019.693425:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bca00, rc 0) 00000100:00100000:2.0:1788864019.693467:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:22625:x1875759226674432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864019.693473:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788864019.693511:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226674432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864019.693525:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a946 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864019.693535:0:22625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a946 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864019.693576:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226674560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788864019.693600:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864019.693614:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642584900 going to sleep for 11 seconds 00000100:00100000:2.0:1788864019.693634:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226674560 00000100:00100000:2.0:1788864019.693638:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226674560 00000100:00100000:2.0:1788864019.693669:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788864019.693675:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:22625:x1875759226674560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788864019.693685:0:22622:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788864019.693697:0:22622:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788864019.693700:0:22622:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788864019.693915:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:22625:x1875759226674560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 239us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864019.693930:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788864019.693985:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226674560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788864019.694024:0:22625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788864019.694030:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a946 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864019.694042:0:22625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a946 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788864019.820920:0:23385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788864020.011383:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:3.0:1788864020.140831:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864021.036139:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:1.0:1788864021.163274:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864022.060583:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 0 seconds 00010000:00010000:2.0:1788864022.197501:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864023.022299:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864023.022322:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226674688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788864023.022396:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864023.022448:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226674688 00000100:00100000:2.0:1788864023.022457:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226674688 00000100:00100000:2.0:1788864023.022513:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788864023.022523:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226674688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788864023.022560:0:22634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788864023.022607:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226674688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864023.022614:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788864023.022656:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226674688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788864023.024400:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226674816:0@lo:400:kworker.0 00000100:00100000:0.0:1788864023.024460:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788864023.024530:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788864023.024535:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788864023.024539:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e676197800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788864023.024552:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff89e676197800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788864023.024575:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67af57480 x1875759226674944/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788864023.024592:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864023.024596:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788864023.024598:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864023.024601:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788864023.024676:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226675072:0@lo:400:kworker.0 00000100:00100000:3.0:1788864023.024715:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864023.024756:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226674944:0@lo:38:kworker.0 00000100:00100000:3.0:1788864023.024783:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864023.024820:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226675072 00000100:00100000:3.0:1788864023.024826:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226675072 00000100:00100000:3.0:1788864023.024882:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788864023.024891:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226675072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864023.024958:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226675072:12345-0@lo:400:kworker.0 Request processed in 67us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864023.024974:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788864023.025001:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226674944 00000100:00100000:3.0:1788864023.025005:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226674944 00000100:00100000:3.0:1788864023.025025:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788864023.025030:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1875759226674944:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788864023.025054:0:23371:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:3.0:1788864023.025113:0:23371:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b6a94d 00000004:00100000:3.0:1788864023.025128:0:23371:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788864023.025134:0:23371:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:3.0:1788864023.025230:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e67af55500 x1875759226675072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864023.025242:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226675072:0@lo:400:kworker.0 00000100:00100000:1.0:1788864023.027194:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226674816 00000100:00100000:1.0:1788864023.027206:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226674816 00000100:00100000:1.0:1788864023.027250:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788864023.027259:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:3640:x1875759226674816:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788864023.027551:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864023.027557:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788864023.027560:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864023.027563:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788864023.027623:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788864023.027636:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226675200:0@lo:400:kworker.0 00000100:00100000:2.0:1788864023.027678:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864023.027723:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226675200 00000100:00100000:2.0:1788864023.027727:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226675200 00000100:00100000:2.0:1788864023.027756:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788864023.027763:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226675200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864023.027801:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226675200:12345-0@lo:400:kworker.0 Request processed in 38us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864023.027807:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788864023.027844:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e67af55f80 x1875759226675200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864023.027869:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226675200:0@lo:400:kworker.0 00000100:00100000:1.0:1788864023.028191:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:3640:x1875759226674816:12345-0@lo:400:kworker.0 Request processed in 933us (3730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864023.028199:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788864023.029297:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226674816:0@lo:400:kworker.0 00000100:00080000:2.0:1788864023.044537:0:23371:0:(import.c:65:import_set_state_nolock()) ffff89e650814000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788864023.044641:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1875759226674944:12345-0@lo:38:kworker.0 Request processed in 19607us (19854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864023.044653:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788864023.044833:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788864023.044844:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788864023.044849:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788864023.044852:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e676197800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788864023.045235:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000059ccc5bb): req@ffff89e67af55c00 x1875759226667648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864023.045260:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226674944:0@lo:38:kworker.0 00000100:00100000:1.0:1788864023.047337:0:22670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864023.047402:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647d97a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788864023.047550:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226667648 00000100:00100000:3.0:1788864023.047559:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226667648 00000100:00100000:3.0:1788864023.047619:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788864023.047629:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22670:x1875759226667648:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788864023.047712:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22670:x1875759226667648:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 85us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864023.047729:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788864023.047802:0:22670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22670:1875759226667648:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788864023.047840:0:22670:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788864023.047893:0:22670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22670:1875759226675328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788864023.048152:0:22670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864023.048189:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6496d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788864023.048205:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226675328 00000100:00100000:1.0:1788864023.048209:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226675328 00000100:00100000:1.0:1788864023.048235:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788864023.048242:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22670:x1875759226675328:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788864023.048612:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22670:x1875759226675328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 368us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864023.048620:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788864023.048665:0:22670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22670:1875759226675328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788864023.048734:0:22670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22670:1875759226675456:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788864023.048760:0:22670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864023.048778:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6496d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788864023.048792:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226675456 00000100:00100000:1.0:1788864023.048796:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226675456 00000100:00100000:1.0:1788864023.048817:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788864023.048823:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22670:x1875759226675456:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788864023.049222:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22670:x1875759226675456:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 398us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864023.049229:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788864023.049359:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226675584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788864023.049397:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864023.049485:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226675584 00000100:00100000:1.0:1788864023.049491:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226675584 00000100:00100000:1.0:1788864023.049529:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788864023.049536:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226675584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788864023.049561:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788864023.049603:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226675584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864023.049609:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788864023.049644:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226675584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788864023.049728:0:22670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22670:1875759226675456:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788864023.049775:0:22670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864023.060196:0:22670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788864023.060307:0:22670:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:3.0:1788864023.060312:0:22670:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:0.0:1788864023.178402:0:23632:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788864023.212279:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788864023.985849:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788864024.235307:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788864024.490187:0:23684:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788864024.490575:0:23684:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788864025.268936:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788864025.759309:0:23735:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788864025.759638:0:23735:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788864026.091531:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864011/real 1788864011] req@ffff89e544209500 x1875759226668800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864026 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864026.091561:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e544209500 x1875759226668800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864026 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864026.091573:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864011/real 1788864011] req@ffff89e544208700 x1875759226668928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864026 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864026.091585:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e544208700 x1875759226668928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864026 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788864026.091621:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544177000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788864026.091802:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788864026.091806:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226668800:0@lo:8:kworker.0 00000100:00080000:0.0:1788864026.091812:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67c45b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788864026.091817:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788864026.091820:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226668928:0@lo:8:kworker.0 00000100:00080000:3.0:1788864026.092022:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788864026.092026:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788864026.092029:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e544177000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788864026.092034:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:3.0:1788864026.092038:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788864026.092048:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89e544177000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788864026.092067:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e543926d80 x1875759226675968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788864026.092244:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226675840:0@lo:400:kworker.0 00000100:00100000:1.0:1788864026.092305:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864026.092360:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788864026.092378:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226675712:0@lo:400:kworker.0 00000100:00100000:1.0:1788864026.092406:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864026.092540:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226675840 00000100:00100000:2.0:1788864026.092550:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226675840 00000100:00100000:2.0:1788864026.092598:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788864026.092623:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226675840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864026.092691:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226675840:12345-0@lo:400:kworker.0 Request processed in 70us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864026.092699:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788864026.092723:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226675712 00000100:00100000:2.0:1788864026.092726:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226675712 00000100:00100000:2.0:1788864026.092751:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788864026.092758:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:3641:x1875759226675712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864026.092785:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:3641:x1875759226675712:12345-0@lo:400:kworker.0 Request processed in 28us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864026.092791:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788864026.092831:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226675712:0@lo:400:kworker.0 00000100:00100000:2.0:1788864026.092841:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226675840:0@lo:400:kworker.0 00000100:00080000:3.0:1788864026.094833:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788864026.094838:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788864026.094842:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e67c45b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788864026.094848:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:3.0:1788864026.094853:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788864026.094866:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e67c45b800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788864026.094955:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226675968:0@lo:8:kworker.0 00000400:00000100:0.0:1788864026.095015:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226675968 offset 0 length 520: 4 00000100:00100000:2.0:1788864026.095165:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e67af57480 x1875759226676096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788864026.095313:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226676352:0@lo:400:kworker.0 00000100:00100000:1.0:1788864026.095352:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864026.095377:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864026.095382:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226676224:0@lo:400:kworker.0 00000100:00100000:1.0:1788864026.095404:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788864026.095451:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864026.095455:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788864026.095457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864026.095460:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788864026.095508:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226676352 00000100:00100000:2.0:1788864026.095515:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226676352 00000100:00100000:2.0:1788864026.095551:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788864026.095575:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226676352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864026.095879:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226676480:0@lo:400:kworker.0 00000100:00100000:1.0:1788864026.095910:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864026.095994:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226676352:12345-0@lo:400:kworker.0 Request processed in 418us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864026.096002:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788864026.096026:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226676224 00000100:00100000:2.0:1788864026.096029:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226676224 00000100:00100000:2.0:1788864026.096051:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226676480 00000100:00100000:2.0:1788864026.096054:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226676480 00000100:00100000:2.0:1788864026.096065:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788864026.096070:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226676224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864026.096130:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226676224:12345-0@lo:400:kworker.0 Request processed in 58us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864026.096136:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788864026.096147:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788864026.096151:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226676480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864026.096181:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226676480:12345-0@lo:400:kworker.0 Request processed in 29us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864026.096186:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788864026.096329:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e67af55880 x1875759226676224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864026.096343:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226676224:0@lo:400:kworker.0 00000100:00100000:1.0:1788864026.096353:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226676352:0@lo:400:kworker.0 00000100:00100000:0.0:1788864026.096423:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226676096:0@lo:8:kworker.0 00000400:00000100:0.0:1788864026.096450:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226676096 offset 0 length 520: 4 00010000:00080000:2.0:1788864026.096507:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e67af56a00 x1875759226676480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864026.096518:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226676480:0@lo:400:kworker.0 00010000:00010000:2.0:1788864026.287479:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788864027.076500:0:23783:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9692db20 20000000:00000080:2.0:1788864027.076518:0:23783:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e659f5a400 uarg=0000000000000000 20000000:01000000:2.0:1788864027.076564:0:23783:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788864027.076574:0:23783:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788864027.076587:0:23783:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788864027.077241:0:23784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788864027.077507:0:23783:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788864027.090630:0:23783:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788864027.090702:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864027.090723:0:23783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e640031000/0xf569beb9d4b6a7fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a7f6 expref: 17 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864027.090732:0:23783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e54357de00/0xf569beb9d4b6a900 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a8f9 expref: 17 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864027.090740:0:23783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864027.090787:0:23783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e54357de00/0xf569beb9d4b6a900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a8f9 expref: 17 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864027.090806:0:23783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e54357de00/0xf569beb9d4b6a900 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a8f9 expref: 17 pid: 22623 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864027.090823:0:23783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23783:1875759226676608:0@lo:104: 00000100:00100000:2.0:1788864027.090890:0:23783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864027.091019:0:22612:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226676608 00000100:00100000:1.0:1788864027.091028:0:22612:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226676608 00010000:00010000:2.0:1788864027.092641:0:23783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e640031000/0xf569beb9d4b6a7fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a7f6 expref: 17 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864027.092656:0:23783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e640031000/0xf569beb9d4b6a7fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a7f6 expref: 17 pid: 22622 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864027.092669:0:23783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23783:1875759226676736:0@lo:104: 00000100:00100000:2.0:1788864027.092724:0:23783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864027.092759:0:23783:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d40fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864027.092852:0:22612:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226676736 00000100:00100000:1.0:1788864027.092859:0:22612:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226676736 00000100:00100000:1.0:1788864027.092897:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864027.092905:0:22612:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+4:23783:x1875759226676608:12345-0@lo:104: 00010000:00010000:1.0:1788864027.092920:0:22612:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a900 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.092986:0:22612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788864027.092992:0:22612:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+4:23783:x1875759226676608:12345-0@lo:104: Request processed in 88us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864027.093008:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864027.093028:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788864027.093034:0:22612:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:23783:x1875759226676736:12345-0@lo:104: 00010000:00010000:1.0:1788864027.093042:0:22612:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a7fd expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093104:0:22612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788864027.093110:0:22612:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:23783:x1875759226676736:12345-0@lo:104: Request processed in 77us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864027.093115:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788864027.093140:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788864027.093146:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a900 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093152:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167d200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788864027.093156:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a900 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093165:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a900 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788864027.093172:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a900 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864027.093178:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788864027.093221:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a900 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093228:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788864027.093256:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a900 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093263:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e64167d200/0xf569beb9d4b6a8f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a900 expref: -99 pid: 23361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093277:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864027.093280:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a7fd expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093285:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e54357c600 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:1.0:1788864027.093288:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a7fd expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093295:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a7fd expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788864027.093301:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a7fd expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864027.093306:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788864027.093321:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a7fd expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093327:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788864027.093341:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a7fd expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093346:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a7f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a7fd expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093368:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864027.093370:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864027.093371:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864027.093377:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864027.093395:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226676864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864027.093426:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864027.093473:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226676992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864027.093496:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864027.093527:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226676864 00000100:00100000:1.0:1788864027.093531:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226676864 00010000:00010000:1.0:1788864027.093551:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e54357de00/0xf569beb9d4b6a900 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a8f9 expref: 18 pid: 22623 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864027.093572:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226676992 00000100:00100000:1.0:1788864027.093575:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226676992 00010000:00010000:1.0:1788864027.093585:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e640031000/0xf569beb9d4b6a7fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a7f6 expref: 19 pid: 22622 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864027.093598:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864027.093604:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:3641:x1875759226676864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788864027.093614:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864027.093618:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e54357de00/0xf569beb9d4b6a900 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a8f9 expref: 19 pid: 22623 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093627:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e54357de00/0xf569beb9d4b6a900 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a8f9 expref: 19 pid: 22623 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093643:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864027.093677:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:3641:x1875759226676864:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864027.093684:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864027.093697:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788864027.093703:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:3642:x1875759226676992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788864027.093710:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864027.093714:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e640031000/0xf569beb9d4b6a7fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a7f6 expref: 18 pid: 22622 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093723:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e640031000/0xf569beb9d4b6a7fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a7f6 expref: 18 pid: 22622 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093734:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093742:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093755:0:22613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093763:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093768:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093775:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093781:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bda00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864027.093790:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093798:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093806:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864027.093816:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864027.093843:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:3642:x1875759226676992:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864027.093849:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788864027.093887:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226676864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864027.093908:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226676992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788864027.094250:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e54357de00/0xf569beb9d4b6a900 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a8f9 expref: 17 pid: 22623 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864027.094265:0:23783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23783:1875759226676608:0@lo:104: 00010000:00010000:2.0:1788864027.094279:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640031000/0xf569beb9d4b6a7fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a7f6 expref: 16 pid: 22622 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864027.094291:0:23783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23783:1875759226676736:0@lo:104: 00010000:00010000:2.0:1788864027.094316:0:23783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864027.094324:0:23783:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864027.094331:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864027.094336:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e6808bda00/0xf569beb9d4b6a954 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864027.116730:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864017/real 1788864017] req@ffff89e67af54e00 x1875759226671104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864027 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864027.116786:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e67af54e00 x1875759226671104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864027 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864027.116797:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864017/real 1788864017] req@ffff89e543926680 x1875759226670976/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864027 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864027.116807:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e543926680 x1875759226670976/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864027 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788864027.116826:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544143000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788864027.116849:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788864027.116853:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226671104:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788864027.116858:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67c44e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788864027.116863:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788864027.116866:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226670976:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788864027.118742:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864027.118757:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788864027.118760:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864027.118763:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788864027.118788:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864027.118791:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788864027.118795:0:38:0:(import.c:65:import_set_state_nolock()) ffff89e67c44e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788864027.118803:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 684 00000100:00080000:0.0:1788864027.118811:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788864027.118822:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89e67c44e000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788864027.118842:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438df800 x1875759226677504/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788864027.118857:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864027.118860:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788864027.118862:0:38:0:(import.c:65:import_set_state_nolock()) ffff89e544143000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788864027.118865:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 684 00000100:00080000:0.0:1788864027.118867:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788864027.118871:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e544143000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788864027.118881:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438de300 x1875759226677632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788864027.119032:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226677760:0@lo:400:kworker.0 00000100:00100000:3.0:1788864027.119129:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864027.119167:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788864027.119173:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226677120:0@lo:400:kworker.0 00000100:00100000:3.0:1788864027.119209:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864027.119239:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226677504:0@lo:8:kworker.0 00000400:00000100:3.0:1788864027.119263:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226677504 offset 0 length 520: 4 00000100:00100000:3.0:1788864027.119288:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226677632:0@lo:8:kworker.0 00000400:00000100:3.0:1788864027.119306:0:3639:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875759226677632 offset 0 length 520: 4 00000100:00100000:1.0:1788864027.120838:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226677248:0@lo:400:kworker.0 00000100:00100000:1.0:1788864027.120902:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864027.120949:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864027.120956:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226677376:0@lo:400:kworker.0 00000100:00100000:1.0:1788864027.120982:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864027.121020:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226677120 00000100:00100000:1.0:1788864027.121028:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226677120 00000100:00100000:1.0:1788864027.121070:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226677376 00000100:00100000:1.0:1788864027.121073:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226677376 00000100:00100000:1.0:1788864027.121118:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788864027.121125:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226677120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864027.121184:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226677120:12345-0@lo:400:kworker.0 Request processed in 59us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864027.121218:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788864027.121236:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788864027.121241:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226677376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864027.121274:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226677376:12345-0@lo:400:kworker.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864027.121280:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788864027.121318:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226677376:0@lo:400:kworker.0 00000100:00100000:1.0:1788864027.121352:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226677120:0@lo:400:kworker.0 00000100:00100000:0.0:1788864027.121739:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226677760 00000100:00100000:0.0:1788864027.121745:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226677760 00000100:00100000:0.0:1788864027.121777:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226677248 00000100:00100000:0.0:1788864027.121780:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226677248 00000100:00100000:0.0:1788864027.121795:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788864027.121801:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226677760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864027.121853:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226677760:12345-0@lo:400:kworker.0 Request processed in 52us (2723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864027.121860:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788864027.121875:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788864027.121881:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226677248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864027.121912:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226677248:12345-0@lo:400:kworker.0 Request processed in 32us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864027.121918:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788864027.121951:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e5438dc380 x1875759226677760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864027.121963:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226677760:0@lo:400:kworker.0 00010000:00080000:0.0:1788864027.121989:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e5438ded80 x1875759226677248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864027.121997:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226677248:0@lo:400:kworker.0 00010000:00010000:2.0:1788864027.310879:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864028.140264:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788864028.140303:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226677888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788864028.140373:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864028.140463:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226677888 00000100:00100000:2.0:1788864028.140482:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226677888 00000100:00100000:2.0:1788864028.140545:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788864028.140554:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226677888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788864028.140600:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788864028.140648:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226677888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864028.140656:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788864028.140706:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226677888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788864028.141677:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788864028.141689:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226678016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788864028.141729:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864028.141763:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226678016 00000100:00100000:2.0:1788864028.141768:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226678016 00000100:00100000:2.0:1788864028.141799:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788864028.141806:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226678016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788864028.141828:0:23371:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788864028.141885:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226678016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864028.141892:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788864028.141925:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226678016:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788864028.336583:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788864028.592127:0:22625:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788864028.592136:0:22625:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e54399a800 from 13 10000000:01000000:3.0:1788864028.592141:0:22625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788864028.592201:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864028.592215:0:22625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864028.592227:0:22625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864028.592253:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226678144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788864028.592320:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864028.592363:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676c0b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788864028.593784:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226678144 00000100:00100000:1.0:1788864028.593795:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226678144 00000100:00100000:1.0:1788864028.593860:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788864028.593870:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+16:22625:x1875759226678144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864028.593886:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864028.593905:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e640031600/0xf569beb9d4b6a962 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a95b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864028.593932:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640031600/0xf569beb9d4b6a962 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a95b expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864028.593943:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e640031600/0xf569beb9d4b6a962 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a95b expref: 17 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864028.593951:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031600, rc 0) 00000100:00100000:1.0:1788864028.594011:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:22625:x1875759226678144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864028.594017:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788864028.594108:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226678144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864028.594123:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a962 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864028.594133:0:22625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a962 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864028.594211:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226678272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864028.594243:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864028.594261:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e651c1e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788864028.594275:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226678272 00000100:00100000:1.0:1788864028.594278:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226678272 00000100:00100000:1.0:1788864028.594298:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788864028.594304:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:22625:x1875759226678272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864028.594407:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:22625:x1875759226678272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864028.594414:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788864028.594441:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226678272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864028.594466:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226678400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864028.594503:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864028.594516:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e651c1e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788864028.594527:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226678400 00000100:00100000:1.0:1788864028.594530:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226678400 00000100:00100000:1.0:1788864028.594546:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788864028.594551:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:22625:x1875759226678400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864028.594624:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:22625:x1875759226678400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864028.594637:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788864028.594673:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226678400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788864028.596789:0:23833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788864028.597767:0:22625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788864028.597800:0:22625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788864028.597810:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a962 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864028.597823:0:22625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a962 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864028.597853:0:22625:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788864028.597856:0:22625:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e680890800 from 13 10000000:01000000:0.0:1788864028.597860:0:22625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788864028.597899:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864028.597913:0:22625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864028.597925:0:22625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864028.597951:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226678528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788864028.598021:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864028.598115:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e643233900 going to sleep for 11 seconds 00000100:00100000:2.0:1788864028.599506:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226678528 00000100:00100000:2.0:1788864028.599517:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226678528 00000100:00100000:2.0:1788864028.599574:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788864028.599585:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+17:22625:x1875759226678528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864028.599600:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864028.599614:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e6808bdc00/0xf569beb9d4b6a970 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a969 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864028.599639:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e6808bdc00/0xf569beb9d4b6a970 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a969 expref: 18 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864028.599650:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e6808bdc00/0xf569beb9d4b6a970 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a969 expref: 18 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864028.599670:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bdc00, rc 0) 00000100:00100000:2.0:1788864028.601782:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:22625:x1875759226678528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2190us (3751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864028.601794:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788864028.607753:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226678528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864028.607784:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a970 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864028.607796:0:22625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a970 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864028.607892:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226678656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788864028.607952:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864028.608006:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e643233900 going to sleep for 11 seconds 00000100:00100000:3.0:1788864028.608115:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226678656 00000100:00100000:3.0:1788864028.608123:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226678656 00000100:00100000:3.0:1788864028.608177:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788864028.608187:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:22625:x1875759226678656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864028.608322:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:22625:x1875759226678656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864028.608331:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788864028.608409:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226678656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864028.608440:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226678784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864028.608485:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864028.608522:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e651c1e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788864028.608581:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226678784 00000100:00100000:3.0:1788864028.608586:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226678784 00000100:00100000:3.0:1788864028.608614:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788864028.608623:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:22625:x1875759226678784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788864028.608714:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:22625:x1875759226678784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864028.608721:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788864028.608747:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226678784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788864028.615922:0:23834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788864028.616155:0:22625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788864028.616187:0:22625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788864028.616199:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a970 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864028.616211:0:22625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a970 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1788864028.654206:0:23362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:1.0:1788864029.036228:0:23385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788864029.355420:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864030.380966:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864031.405578:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788864032.235788:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864032.235795:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788864032.235798:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864032.235801:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788864032.235818:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864032.235821:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788864032.235824:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864032.235827:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788864032.235860:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226679040:0@lo:400:kworker.0 00000100:00100000:2.0:1788864032.235932:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864032.235997:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864032.236004:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226679168:0@lo:400:kworker.0 00000100:00100000:2.0:1788864032.236031:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864032.236060:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226679040 00000100:00100000:2.0:1788864032.236066:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226679040 00000100:00100000:2.0:1788864032.236147:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788864032.236168:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226679040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864032.236220:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226679040:12345-0@lo:400:kworker.0 Request processed in 53us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864032.236228:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788864032.236274:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226679040:0@lo:400:kworker.0 00000100:00100000:0.0:1788864032.236346:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226678912:0@lo:400:kworker.0 00000100:00100000:0.0:1788864032.236382:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864032.236425:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226679424:0@lo:400:kworker.0 00000100:00100000:0.0:1788864032.236447:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864032.236464:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788864032.236469:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226679296:0@lo:400:kworker.0 00000100:00100000:0.0:1788864032.236493:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864032.236533:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226679168 00000100:00100000:0.0:1788864032.236537:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226679168 00000100:00100000:0.0:1788864032.236564:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226679424 00000100:00100000:0.0:1788864032.236568:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226679424 00000100:00100000:0.0:1788864032.236583:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788864032.236589:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226679168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864032.242496:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226679168:12345-0@lo:400:kworker.0 Request processed in 5894us (6451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864032.242523:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788864032.242560:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788864032.242571:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226679424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864032.242634:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226679424:12345-0@lo:400:kworker.0 Request processed in 67us (6185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864032.242641:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788864032.242673:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226678912 00000100:00100000:0.0:1788864032.242681:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226678912 00000100:00100000:0.0:1788864032.242719:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788864032.242726:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:3641:x1875759226678912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864032.242771:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:3641:x1875759226678912:12345-0@lo:400:kworker.0 Request processed in 45us (6388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864032.242777:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788864032.242811:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226679296 00000100:00100000:0.0:1788864032.242815:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226679296 00000100:00100000:0.0:1788864032.242840:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788864032.242846:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226679296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864032.242878:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226679296:12345-0@lo:400:kworker.0 Request processed in 32us (6384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864032.242884:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788864032.242931:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226679296:0@lo:400:kworker.0 00000100:00100000:0.0:1788864032.242943:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226678912:0@lo:400:kworker.0 00010000:00080000:0.0:1788864032.242957:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e67af54e00 x1875759226679424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864032.242967:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226679424:0@lo:400:kworker.0 00010000:00080000:2.0:1788864032.251375:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e67af57800 x1875759226679168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864032.251394:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226679168:0@lo:400:kworker.0 00010000:00010000:1.0:1788864032.428111:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788864033.195708:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788864033.260550:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788864033.260572:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226679552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788864033.260658:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864033.260701:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226679552 00000100:00100000:1.0:1788864033.260709:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226679552 00000100:00100000:1.0:1788864033.260754:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788864033.260762:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226679552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788864033.260798:0:23371:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788864033.260844:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226679552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864033.260851:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788864033.260895:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226679552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788864033.273766:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226679680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788864033.273841:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864033.273899:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226679680 00000100:00100000:0.0:1788864033.273907:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226679680 00000100:00100000:0.0:1788864033.273951:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788864033.273959:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226679680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788864033.273995:0:22634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788864033.274042:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226679680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864033.274056:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788864033.274130:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226679680:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788864033.452073:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864034.477442:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788864035.434948:0:24131:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788864035.434954:0:24131:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788864035.434955:0:24131:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788864035.435135:0:24131:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89e659e55000 00000020:01000004:3.0:1788864035.435159:0:24131:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788864035.435179:0:24131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788864035.435200:0:24131:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff89e681bfcd40) 00000020:00000080:3.0:1788864035.435223:0:24131:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1788864035.499277:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788864035.531834:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788864035.533690:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788864035.534563:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788864035.535236:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788864035.535624:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788864035.535887:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788864035.536299:0:24131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1788864035.542837:0:24131:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788864035.543691:0:24131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788864035.543713:0:24131:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788864035.543730:0:24131:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf569beb9d4b6a97e 00000020:01000004:3.0:1788864035.543739:0:24131:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788864035.543770:0:24131:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788864035.543774:0:24131:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788864035.543784:0:24131:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788864035.543790:0:24131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788864035.543807:0:24131:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff89e681bf99c0) 00000020:00000080:3.0:1788864035.543822:0:24131:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788864035.552063:0:24131:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788864035.553205:0:24131:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788864035.553217:0:24131:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788864035.556236:0:24131:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788864035.556249:0:24131:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788864035.557679:0:24131:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788864035.557689:0:24131:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788864035.565149:0:24131:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788864035.565367:0:24131:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788864035.565374:0:24131:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788864035.567256:0:24131:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788864035.567276:0:24131:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788864035.587701:0:24131:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788864035.588054:0:24131:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788864035.588061:0:24131:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788864035.594711:0:24131:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788864035.594747:0:24131:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788864035.596107:0:24131:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788864035.596123:0:24131:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788864035.598792:0:24131:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788864035.599003:0:24131:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788864035.599009:0:24131:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788864035.599911:0:24131:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788864035.599920:0:24131:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788864035.639583:0:24131:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788864035.639821:0:24131:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788864035.639828:0:24131:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788864035.644118:0:24131:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788864035.644138:0:24131:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788864035.647682:0:24131:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788864035.647732:0:24131:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788864035.647741:0:24131:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788864035.705177:0:24131:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788864035.705300:0:24131:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.135@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788864035.705307:0:24131:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788864035.705309:0:24131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788864035.705310:0:24131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864035.705312:0:24131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864035.705313:0:24131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864035.705314:0:24131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864035.705316:0:24131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788864035.705318:0:24131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864035.705320:0:24131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788864035.705324:0:24131:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788864035.705327:0:24131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788864035.705328:0:24131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788864035.705330:0:24131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864035.705331:0:24131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864035.705332:0:24131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864035.705333:0:24131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864035.705334:0:24131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788864035.705335:0:24131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864035.705336:0:24131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788864035.705378:0:24131:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788864035.705411:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226679808:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788864035.705539:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864035.705618:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5428020c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864035.706774:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226679808 00000100:00100000:1.0:1788864035.706792:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226679808 00000100:00100000:1.0:1788864035.706877:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788864035.706902:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:24131:x1875759226679808:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788864035.706965:0:22623:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788864035.706969:0:22623:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788864035.706974:0:22623:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788864035.710290:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:24131:x1875759226679808:12345-0@lo:253:mount.lustre.0 Request processed in 3376us (4736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864035.710311:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788864035.710843:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226679808:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788864035.710866:0:24131:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788864035.710869:0:24131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788864035.710871:0:24131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788864035.710873:0:24131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864035.710874:0:24131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864035.710875:0:24131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864035.710877:0:24131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864035.710878:0:24131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788864035.710880:0:24131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864035.710901:0:24131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788864035.711114:0:24131:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e659e55000 from lustre-OST0000 10000000:01000000:3.0:1788864035.711177:0:24131:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788864035.711181:0:24131:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788864035.711192:0:24131:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89e66c64b380 local copy 00010000:00010000:3.0:1788864035.711207:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a740 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864035.711824:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226679936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864035.711899:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864035.712198:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542802a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788864035.714234:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226679936 00000100:00100000:0.0:1788864035.714319:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226679936 00000100:00100000:0.0:1788864035.714473:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788864035.714497:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:24131:x1875759226679936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864035.715031:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:24131:x1875759226679936:12345-0@lo:501:mount.lustre.0 Request processed in 526us (3120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788864035.715040:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788864035.719639:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226679936:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788864035.719684:0:24131:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788864035.719762:0:24131:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788864035.719775:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a740 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.719799:0:24131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a740 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788864035.719876:0:24131:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e659e55000 10000000:01000000:1.0:1788864035.719882:0:24131:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788864035.719890:0:24131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788864035.719910:0:24131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788864035.719916:0:24131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788864035.719919:0:24131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788864035.719967:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b6a98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.719982:0:24131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b6a98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.719995:0:24131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b6a98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864035.720037:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788864035.721546:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864035.721643:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e643233900 going to sleep for 11 seconds 00000100:00100000:3.0:1788864035.726674:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226680064 00000100:00100000:3.0:1788864035.726698:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226680064 00000100:00100000:3.0:1788864035.726908:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788864035.726922:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+18:24131:x1875759226680064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864035.726946:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864035.726971:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167da00/0xf569beb9d4b6a993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a98c expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864035.727010:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167da00/0xf569beb9d4b6a993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a98c expref: 19 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864035.727034:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167da00/0xf569beb9d4b6a993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a98c expref: 19 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864035.727044:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167da00, rc 0) 00000100:00100000:3.0:1788864035.727197:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:24131:x1875759226680064:12345-0@lo:101:mount.lustre.0 Request processed in 277us (5658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864035.727204:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788864035.741069:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864035.741151:0:24131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b6a98c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a993 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.741166:0:24131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b6a98c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a993 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788864035.749429:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788864035.753857:0:24131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788864035.764719:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788864035.764801:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788864035.764818:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788864035.764835:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788864035.764874:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788864035.764889:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788864035.764903:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788864035.764917:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788864035.764931:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788864035.764958:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788864035.764976:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788864035.764991:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788864035.765033:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788864035.765040:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788864035.765247:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864035.768563:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864035.768629:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6763026c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864035.769039:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226680192 00000100:00100000:0.0:1788864035.769052:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226680192 00000100:00100000:0.0:1788864035.769159:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788864035.769172:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:24131:x1875759226680192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864035.769435:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:24131:x1875759226680192:12345-0@lo:501:mount.lustre.0 Request processed in 265us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864035.769443:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788864035.771133:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864035.771234:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788864035.771365:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864035.771429:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6763026c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864035.773619:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226680320 00000100:00100000:3.0:1788864035.773656:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226680320 00000100:00100000:3.0:1788864035.773736:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788864035.773746:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:24131:x1875759226680320:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788864035.774923:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:24131:x1875759226680320:12345-0@lo:503:mount.lustre.0 Request processed in 1158us (3538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864035.774940:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788864035.775424:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680320:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788864035.778846:0:24131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788864035.779114:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864035.779232:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864035.779376:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676c0b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788864035.779640:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226680448 00000100:00100000:1.0:1788864035.779651:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226680448 00000100:00100000:1.0:1788864035.779724:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788864035.779737:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:24131:x1875759226680448:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788864035.780746:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:24131:x1875759226680448:12345-0@lo:502:mount.lustre.0 Request processed in 1005us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864035.780760:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788864035.780993:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788864035.781897:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788864035.783899:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788864035.784015:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788864035.784043:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788864035.784120:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788864035.784137:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788864035.784149:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788864035.784161:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788864035.784172:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788864035.784185:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788864035.784199:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788864035.784213:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788864035.784365:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864035.784485:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864035.784624:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64554b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788864035.784750:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226680576 00000100:00100000:0.0:1788864035.784761:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226680576 00000100:00100000:0.0:1788864035.784878:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788864035.784890:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:24131:x1875759226680576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788864035.785111:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:24131:x1875759226680576:12345-0@lo:502:mount.lustre.0 Request processed in 187us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864035.785121:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788864035.785403:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788864035.785493:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788864035.785513:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788864035.787059:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788864035.787101:0:24148:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788864035.787113:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864035.787116:0:24148:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788864035.787124:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788864035.787148:0:24148:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff89e5428eb380) 00000020:00000080:2.0:1788864035.787185:0:24148:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788864035.787191:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788864035.787291:0:24148:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e659e55000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788864035.787300:0:24148:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788864035.787309:0:24148:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf569beb9d4b6a9a1 00010000:00010000:2.0:1788864035.793797:0:24148:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788864035.794698:0:24148:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:2.0:1788864035.799767:0:24148:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788864035.807484:0:24148:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788864035.807503:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864035.807512:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864035.807514:0:24148:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788864035.807519:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788864035.807522:0:24148:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788864035.807524:0:24148:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788864035.807525:0:24148:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788864035.807527:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788864035.807530:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864035.807531:0:24148:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788864035.807550:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864035.807554:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864035.807555:0:24148:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788864035.807558:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788864035.807560:0:24148:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788864035.807563:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864035.807565:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864035.807566:0:24148:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788864035.807569:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864035.807571:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864035.807572:0:24148:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788864035.807575:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788864035.807621:0:24148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864035.807624:0:24148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864035.807626:0:24148:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788864035.807630:0:24148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1788864035.815881:0:24131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788864035.815977:0:24131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788864035.816009:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b6a98c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a993 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.816039:0:24131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640030400/0xf569beb9d4b6a98c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a993 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864035.816111:0:24131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e659e55000 from 1 10000000:01000000:0.0:1788864035.816116:0:24131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788864035.816187:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.816197:0:24131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.816214:0:24131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864035.819062:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788864035.819211:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864035.820162:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788864035.820840:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226680704 00000100:00100000:1.0:1788864035.820857:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226680704 00000100:00100000:1.0:1788864035.821428:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788864035.821445:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:24131:x1875759226680704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788864035.821474:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864035.821504:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e640030000/0xf569beb9d4b6a9af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a9a8 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.821551:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640030000/0xf569beb9d4b6a9af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a9a8 expref: 20 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.821565:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e640030000/0xf569beb9d4b6a9af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a9a8 expref: 20 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.821576:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640030000, rc 0) 00000100:00100000:1.0:1788864035.821686:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:24131:x1875759226680704:12345-0@lo:101:mount.lustre.0 Request processed in 247us (2478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864035.821694:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788864035.823474:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864035.823513:0:24131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a9af expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864035.823529:0:24131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a9af expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788864035.836068:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788864035.836774:0:24131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788864035.837248:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788864035.837281:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788864035.837296:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788864035.837311:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788864035.837325:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788864035.837339:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788864035.837353:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788864035.837367:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788864035.837382:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788864035.837396:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788864035.837408:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788864035.837448:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788864035.837455:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788864035.837668:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864035.837771:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864035.838024:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6467b66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864035.838172:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226680832 00000100:00100000:0.0:1788864035.838185:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226680832 00000100:00100000:0.0:1788864035.838289:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788864035.838302:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:24131:x1875759226680832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864035.838475:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:24131:x1875759226680832:12345-0@lo:501:mount.lustre.0 Request processed in 173us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864035.838485:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788864035.838603:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864035.838653:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788864035.838707:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864035.838738:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6467b66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864035.839186:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226680960 00000100:00100000:0.0:1788864035.839191:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226680960 00000100:00100000:0.0:1788864035.839226:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788864035.839233:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:24131:x1875759226680960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788864035.839527:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:24131:x1875759226680960:12345-0@lo:503:mount.lustre.0 Request processed in 293us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864035.839546:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788864035.840268:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226680960:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788864035.840897:0:24131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788864035.841039:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864035.841161:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864035.841212:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642f69600 going to sleep for 11 seconds 00000100:00100000:0.0:1788864035.842416:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226681088 00000100:00100000:0.0:1788864035.842433:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226681088 00000100:00100000:0.0:1788864035.842507:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788864035.842519:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:24131:x1875759226681088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788864035.842724:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:24131:x1875759226681088:12345-0@lo:502:mount.lustre.0 Request processed in 207us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864035.842732:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788864035.844235:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788864035.844595:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788864035.844632:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788864035.844646:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788864035.844657:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788864035.844672:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788864035.844685:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788864035.844698:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788864035.844710:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788864035.844724:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788864035.844735:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788864035.844745:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788864035.844794:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864035.844887:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864035.844947:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642f69600 going to sleep for 11 seconds 00000100:00100000:0.0:1788864035.848522:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226681216 00000100:00100000:0.0:1788864035.848552:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226681216 00000100:00100000:0.0:1788864035.848656:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788864035.848670:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:24131:x1875759226681216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788864035.848939:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:24131:x1875759226681216:12345-0@lo:502:mount.lustre.0 Request processed in 271us (4051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864035.848947:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788864035.849562:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681216:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788864035.849706:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788864035.849725:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788864035.854449:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864035.854469:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864035.854472:0:24152:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788864035.854481:0:24152:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e659e55000 00000020:00000080:0.0:1788864035.854485:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788864035.854496:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864035.854499:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864035.854501:0:24152:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788864035.854504:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864035.854524:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864035.854526:0:24152:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788864035.854530:0:24152:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e659e55000 00000020:00000080:0.0:1788864035.854532:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788864035.854621:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864035.854625:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864035.854626:0:24152:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788864035.854629:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864035.854631:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864035.854633:0:24152:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788864035.854636:0:24152:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e659e55000 00000020:00000080:0.0:1788864035.854639:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788864035.854657:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864035.854660:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864035.854662:0:24152:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788864035.854664:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788864035.854666:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864035.854668:0:24152:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788864035.854671:0:24152:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e659e55000 00000020:00000080:0.0:1788864035.854673:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788864035.854696:0:24152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788864035.854700:0:24152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788864035.854702:0:24152:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788864035.854705:0:24152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788864035.860381:0:24131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788864035.860451:0:24131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788864035.860479:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a9af expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864035.860497:0:24131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a9af expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864035.867469:0:24131:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788864035.867481:0:24131:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e659e55000 10000000:01000000:0.0:1788864035.867486:0:24131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e659e55000 10000000:01000000:0.0:1788864035.867492:0:24131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788864035.867502:0:24131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e659e55000 from 1 10000000:01000000:0.0:1788864035.867507:0:24131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788864035.867596:0:24131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a9b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.867627:0:24131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a9b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.867643:0:24131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a9b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864035.867684:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788864035.867796:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864035.871297:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788864035.877147:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226681344 00000100:00100000:1.0:1788864035.877162:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226681344 00000100:00100000:1.0:1788864035.877235:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788864035.877246:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:24131:x1875759226681344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788864035.877268:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864035.877290:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e640031000/0xf569beb9d4b6a9bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a9b6 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.877321:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640031000/0xf569beb9d4b6a9bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a9b6 expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.877334:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e640031000/0xf569beb9d4b6a9bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a9b6 expref: 21 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.877433:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e640031000, rc 0) 00000100:00100000:1.0:1788864035.877588:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24131:x1875759226681344:12345-0@lo:101:mount.lustre.0 Request processed in 343us (9791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864035.877595:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788864035.878222:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864035.878268:0:24131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a9b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a9bd expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.878283:0:24131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a9b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a9bd expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788864035.885221:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788864035.885673:0:24131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788864035.888611:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788864035.888701:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788864035.888717:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788864035.888733:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788864035.888747:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788864035.888760:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788864035.888776:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788864035.888821:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788864035.888839:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788864035.888851:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788864035.888875:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788864035.888891:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788864035.888903:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788864035.888916:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788864035.888928:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788864035.888941:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788864035.888957:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788864035.888971:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788864035.888983:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788864035.888997:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788864035.889009:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788864035.889034:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788864035.889049:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788864035.889124:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788864035.889144:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788864035.889158:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788864035.889170:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788864035.889182:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788864035.889195:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788864035.889209:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788864035.889221:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788864035.889232:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788864035.889246:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788864035.889272:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788864035.889288:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788864035.889302:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788864035.889315:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788864035.889330:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788864035.889344:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788864035.889374:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788864035.889390:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788864035.889404:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788864035.889418:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788864035.889442:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788864035.889456:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788864035.889470:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788864035.889484:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788864035.889498:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788864035.896217:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788864035.896305:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788864035.896333:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788864035.896340:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788864035.896502:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864035.896604:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864035.896684:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788864035.899305:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226681472 00000100:00100000:0.0:1788864035.899332:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226681472 00000100:00100000:0.0:1788864035.899424:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788864035.899438:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24131:x1875759226681472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864035.900112:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24131:x1875759226681472:12345-0@lo:501:mount.lustre.0 Request processed in 674us (3504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864035.900124:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788864035.900212:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864035.900429:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788864035.900492:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864035.900536:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788864035.900646:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226681600 00000100:00100000:3.0:1788864035.900654:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226681600 00000100:00100000:3.0:1788864035.900712:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788864035.900720:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24131:x1875759226681600:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788864035.900834:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24131:x1875759226681600:12345-0@lo:503:mount.lustre.0 Request processed in 115us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864035.900842:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788864035.901048:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681600:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788864035.901855:0:24131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788864035.902329:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788864035.902425:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864035.902529:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788864035.902876:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226681728 00000100:00100000:3.0:1788864035.902889:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226681728 00000100:00100000:3.0:1788864035.903071:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788864035.903100:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24131:x1875759226681728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864035.903249:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24131:x1875759226681728:12345-0@lo:502:mount.lustre.0 Request processed in 152us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864035.903269:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788864035.905432:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788864035.909146:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788864035.909326:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788864035.909348:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788864035.909363:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788864035.909375:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788864035.909386:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788864035.909397:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788864035.909408:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788864035.909419:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788864035.909430:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788864035.909441:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788864035.909452:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788864035.909463:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788864035.909474:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788864035.909487:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788864035.909498:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788864035.909510:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788864035.909539:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788864035.909554:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788864035.909567:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788864035.909578:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788864035.909590:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788864035.909602:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788864035.909613:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788864035.909624:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788864035.909635:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788864035.909651:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788864035.909661:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788864035.909672:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788864035.909683:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788864035.909703:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788864035.909713:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788864035.909724:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788864035.909745:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788864035.909756:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788864035.909767:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788864035.909778:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788864035.909788:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788864035.909799:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788864035.909809:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788864035.909819:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788864035.909829:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788864035.909839:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788864035.909849:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788864035.909860:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788864035.909870:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788864035.909881:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788864035.909891:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788864035.911121:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681856:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788864035.911241:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864035.911309:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788864035.912031:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226681856 00000100:00100000:3.0:1788864035.912047:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226681856 00000100:00100000:3.0:1788864035.912162:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788864035.912175:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24131:x1875759226681856:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864035.913189:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24131:x1875759226681856:12345-0@lo:502:mount.lustre.0 Request processed in 367us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864035.913203:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788864035.913510:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788864035.914195:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788864035.914237:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788864035.914303:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681984:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788864035.914393:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864035.914446:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226681984 00000100:00100000:0.0:1788864035.914453:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226681984 00000100:00100000:0.0:1788864035.914508:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788864035.914518:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24131:x1875759226681984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788864035.915291:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24131:x1875759226681984:12345-0@lo:502:mount.lustre.0 Request processed in 769us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864035.915303:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788864035.915394:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e648b9ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788864035.915420:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226681984:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788864035.915502:0:24131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788864035.915518:0:24131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788864035.917449:0:24157:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788864035.917477:0:24157:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89e543a1cd40) 00000020:00000080:0.0:1788864035.917515:0:24157:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788864035.917612:0:24157:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e659e55000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788864035.917617:0:24157:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e659e55000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788864035.917621:0:24157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e659e55000 3 00010000:00080000:0.0:1788864035.917665:0:24157:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e544891800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.135@tcp at head 00010000:00010000:0.0:1788864035.924579:0:24157:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788864035.925034:0:24157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788864035.925144:0:24157:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788864035.925165:0:24157:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf569beb9d4b6a9cb 00000100:00080000:0.0:1788864035.925181:0:24157:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788864035.925198:0:24157:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e544891800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788864035.925264:0:24157:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438dc700 x1875759226682112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788864035.925296:0:24157:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788864035.925505:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226682112:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788864035.925630:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788864035.925778:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864035.925783:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788864035.925787:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864035.925790:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788864035.925824:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864035.925828:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788864035.925832:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864035.925836:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788864035.926139:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226682240:0@lo:400:kworker.0 00000100:00100000:1.0:1788864035.926183:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864035.926207:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864035.926212:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226682368:0@lo:400:kworker.0 00000100:00100000:1.0:1788864035.926234:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864035.926287:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226682496:0@lo:400:kworker.0 00000100:00100000:1.0:1788864035.926319:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864035.926352:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788864035.926357:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226682624:0@lo:400:kworker.0 00000100:00100000:1.0:1788864035.926378:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864035.926422:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226682240 00000100:00100000:1.0:1788864035.926433:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226682240 00000100:00100000:1.0:1788864035.926478:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226682496 00000100:00100000:1.0:1788864035.926481:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226682496 00000100:00100000:1.0:1788864035.926500:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788864035.926509:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226682240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864035.926588:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226682240:12345-0@lo:400:kworker.0 Request processed in 78us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864035.926597:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788864035.926619:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788864035.926626:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226682496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864035.926658:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226682496:12345-0@lo:400:kworker.0 Request processed in 33us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864035.926664:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788864035.926685:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226682112 00000100:00100000:1.0:1788864035.926689:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226682112 00000100:00100000:1.0:1788864035.926700:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226682368 00000100:00100000:1.0:1788864035.926703:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226682368 00000100:00100000:1.0:1788864035.926716:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226682624 00000100:00100000:1.0:1788864035.926719:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226682624 00000100:00100000:1.0:1788864035.926732:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788864035.926738:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226682368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864035.926768:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226682368:12345-0@lo:400:kworker.0 Request processed in 30us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864035.926774:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788864035.926797:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788864035.926802:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226682624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864035.926833:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226682624:12345-0@lo:400:kworker.0 Request processed in 31us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864035.926839:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788864035.926849:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864035.926853:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226682112:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788864035.926884:0:22628:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:1.0:1788864035.926940:0:22628:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf569beb9d4b6a9d2 00000004:00100000:1.0:1788864035.926961:0:22628:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788864035.927006:0:22628:0:(import.c:65:import_set_state_nolock()) ffff89e542586800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864035.927065:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875759226682112:12345-0@lo:38:llog_process_th.0 Request processed in 209us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864035.927072:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788864035.927170:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e54408ca80 x1875759226682368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864035.927187:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226682368:0@lo:400:kworker.0 00000100:00100000:1.0:1788864035.927198:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226682240:0@lo:400:kworker.0 00010000:00080000:1.0:1788864035.927230:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e54408c000 x1875759226682624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864035.927240:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226682624:0@lo:400:kworker.0 00000100:00100000:1.0:1788864035.927250:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226682496:0@lo:400:kworker.0 00010000:00080000:1.0:1788864035.927272:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e5438dc700 x1875759226682112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788864045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864035.927288:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788864035.927297:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788864035.927307:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788864035.927312:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788864035.927315:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544891800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788864035.927322:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875759226682112:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1788864035.928750:0:24157:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788864035.928776:0:24157:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff89e65862b380) 00000020:00000080:1.0:1788864035.928823:0:24157:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788864035.929070:0:24157:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e659e55000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788864035.929096:0:24157:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e659e55000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788864035.929099:0:24157:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e659e55000 3 00010000:00080000:1.0:1788864035.929153:0:24157:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e542584000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1788864035.942458:0:24157:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788864035.942995:0:24157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788864035.943182:0:24157:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788864035.943207:0:24157:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf569beb9d4b6a9e0 00000100:00080000:1.0:1788864035.943225:0:24157:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788864035.943244:0:24157:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff89e542584000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788864035.943383:0:24157:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e54408c700 x1875759226682752/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788864035.943420:0:24157:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788864035.943461:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864035.943467:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788864035.943472:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864035.943485:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788864035.943492:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864035.943496:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788864035.943501:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864035.943504:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788864035.943633:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875759226682752:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788864035.943748:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864035.943913:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226682752 00000100:00100000:1.0:1788864035.943927:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226682752 00000100:00100000:1.0:1788864035.943981:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788864035.943994:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875759226682752:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788864035.944162:0:22628:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:1.0:1788864035.944230:0:22628:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf569beb9d4b6a9e7 00000004:00100000:1.0:1788864035.944254:0:22628:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788864035.944502:0:22628:0:(import.c:65:import_set_state_nolock()) ffff89e542583000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864035.944686:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875759226682752:12345-0@lo:38:llog_process_th.0 Request processed in 690us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864035.944706:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788864035.947151:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e54408c700 x1875759226682752/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788864045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864035.947172:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788864035.947187:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788864035.947200:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788864035.947207:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788864035.947211:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e542584000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788864035.947220:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875759226682752:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788864035.959694:0:24157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788864035.960720:0:24131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788864035.960786:0:24131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788864035.961110:0:24131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a9b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a9bd expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.961127:0:24131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e54357c600/0xf569beb9d4b6a9b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a9bd expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788864035.961207:0:24131:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788864035.961210:0:24131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788864035.961212:0:24131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864035.961213:0:24131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788864035.961214:0:24131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864035.961216:0:24131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864035.961217:0:24131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788864035.961219:0:24131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864035.961221:0:24131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788864035.961226:0:24131:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788864035.961228:0:24131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788864035.961229:0:24131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788864035.961231:0:24131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864035.961232:0:24131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788864035.961233:0:24131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864035.961234:0:24131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864035.961235:0:24131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788864035.961236:0:24131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864035.961238:0:24131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788864035.963762:0:24131:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788864035.963816:0:24131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226682880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788864035.963925:0:24131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864035.963996:0:24131:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6496d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1788864035.964226:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226682880 00000100:00100000:0.0:1788864035.964255:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226682880 00000100:00100000:0.0:1788864035.964348:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788864035.964359:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24131:x1875759226682880:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788864035.964401:0:22621:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788864035.964450:0:22621:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788864035.975780:0:22621:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788864035.975881:0:22621:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788864035.976338:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24131:x1875759226682880:12345-0@lo:253:mount.lustre.0 Request processed in 11972us (12403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864035.976378:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788864035.976737:0:24131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24131:1875759226682880:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788864035.976763:0:24131:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788864035.976767:0:24131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788864035.976769:0:24131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788864035.976770:0:24131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864035.976772:0:24131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788864035.976773:0:24131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864035.976775:0:24131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864035.976777:0:24131:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788864035.976779:0:24131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864035.976781:0:24131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788864035.977071:0:24131:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788864035.977897:0:22644:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788864035.977993:0:22644:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788864035.978212:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.978236:0:22644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e54357c400/0xf569beb9d4b6a938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a931 expref: 20 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.978244:0:22644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e6808bca00/0xf569beb9d4b6a946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a93f expref: 20 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.978253:0:22644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.978371:0:22644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e6808bca00/0xf569beb9d4b6a946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a93f expref: 20 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.978388:0:22644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e6808bca00/0xf569beb9d4b6a946 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a93f expref: 20 pid: 22623 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864035.978407:0:22644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226683008:0@lo:104: 00000100:00100000:1.0:1788864035.978642:0:22644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788864035.978752:0:22644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e54357c400/0xf569beb9d4b6a938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a931 expref: 20 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.978761:0:22644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e54357c400/0xf569beb9d4b6a938 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a931 expref: 20 pid: 22621 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864035.978770:0:22644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226683136:0@lo:104: 00000100:00100000:1.0:1788864035.978802:0:22644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864035.981214:0:22644:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6496d60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864035.981294:0:22611:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788864035.981331:0:22611:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226683008 00000100:00100000:0.0:1788864035.981344:0:22611:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226683008 00000001:00000004:3.0:1788864035.981365:0:24131:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1788864035.981394:0:22611:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226683136 00000100:00100000:0.0:1788864035.981399:0:22611:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226683136 00000100:00100000:0.0:1788864035.981437:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788864035.981455:0:22611:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+4:22644:x1875759226683008:12345-0@lo:104: 00010000:00010000:0.0:1788864035.981484:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a946 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864035.981738:0:22644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226683008:0@lo:104: 00010000:00010000:0.0:1788864035.981837:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788864035.981849:0:22611:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+4:22644:x1875759226683008:12345-0@lo:104: Request processed in 399us (3206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864035.981862:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788864035.981885:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788864035.981892:0:22611:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6492b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:22644:x1875759226683136:12345-0@lo:104: 00010000:00010000:0.0:1788864035.981900:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a938 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.981948:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788864035.981956:0:22611:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6492b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:22644:x1875759226683136:12345-0@lo:104: Request processed in 64us (3153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864035.981986:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788864035.982145:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788864035.982158:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a946 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.982172:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030800 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788864035.982180:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a946 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.982195:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a946 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864035.982207:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a946 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864035.982217:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864035.982274:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a946 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.982281:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864035.982308:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a946 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.982316:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a93f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a946 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.982331:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864035.982335:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a938 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.982354:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031400 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:0.0:1788864035.982358:0:22616:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a938 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.982365:0:22616:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a938 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788864035.982372:0:22616:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a938 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864035.982378:0:22616:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788864035.982395:0:22616:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a938 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.982401:0:22616:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788864035.982407:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a938 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.982414:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640031400/0xf569beb9d4b6a931 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a938 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.982433:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864035.982435:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864035.982437:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864035.982651:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226683264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864035.982704:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864035.982757:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864035.982764:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226683392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864035.982790:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864035.982848:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226683264 00000100:00100000:1.0:1788864035.982856:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226683264 00010000:00010000:1.0:1788864035.982887:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e6808bca00/0xf569beb9d4b6a946 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a93f expref: 21 pid: 22623 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864035.983005:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226683392 00000100:00100000:1.0:1788864035.983029:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864035.983039:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:3640:x1875759226683264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788864035.983053:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864035.983060:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e6808bca00/0xf569beb9d4b6a946 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a93f expref: 21 pid: 22623 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.983107:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e6808bca00/0xf569beb9d4b6a946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a93f expref: 21 pid: 22623 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.983128:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e6808bca00/0xf569beb9d4b6a946 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a93f expref: 21 pid: 22623 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864035.983146:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864035.983182:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:3640:x1875759226683264:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864035.983189:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864035.983232:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226683264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864035.983408:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864035.983431:0:22644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226683136:0@lo:104: 00010000:00010000:1.0:1788864035.983453:0:22644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864035.983556:0:22612:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1788864035.983671:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226683392 00010000:00010000:0.0:1788864035.983735:0:22615:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e54357c400/0xf569beb9d4b6a938 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a931 expref: 20 pid: 22621 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864035.983793:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788864035.983822:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643881450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:3640:x1875759226683392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788864035.983840:0:22615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864035.983850:0:22615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e54357c400/0xf569beb9d4b6a938 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a931 expref: 20 pid: 22621 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.983866:0:22615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e54357c400/0xf569beb9d4b6a938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a931 expref: 20 pid: 22621 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.983878:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e54357c400/0xf569beb9d4b6a938 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a931 expref: 20 pid: 22621 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.983896:0:22615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.983905:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788864035.983922:0:22615:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005929757s 00010000:00010000:0.0:1788864035.983927:0:22615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.983935:0:22615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.983942:0:22615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.983949:0:22615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.983956:0:22615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864035.983968:0:22615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.983977:0:22615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.983998:0:22615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864035.984009:0:22615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864035.984109:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643881450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:3640:x1875759226683392:12345-0@lo:103:ldlm_bl.0 Request processed in 292us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864035.984120:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788864035.984144:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226683392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788864035.984220:0:22644:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864035.984230:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864035.984236:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640031800/0xf569beb9d4b6a9ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788864035.986394:0:24131:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788864035.986405:0:24131:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788864035.986452:0:24131:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788864035.986507:0:24131:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788864035.986529:0:24131:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788864035.986551:0:24131:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788864035.987509:0:24131:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788864035.987763:0:24131:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788864036.523389:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788864037.106759:0:24210:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788864037.107897:0:24210:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788864037.486997:0:22625:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788864037.487005:0:22625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e54399a800 from 13 10000000:01000000:1.0:1788864037.487012:0:22625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788864037.487071:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864037.487130:0:22625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864037.487143:0:22625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864037.487171:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226683520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788864037.487250:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864037.487298:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c6579c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864037.487746:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226683520 00000100:00100000:0.0:1788864037.487765:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226683520 00000100:00100000:0.0:1788864037.487847:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788864037.487858:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+19:22625:x1875759226683520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864037.487880:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864037.487918:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e54357dc00/0xf569beb9d4b6a9fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6a9f5 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864037.487954:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e54357dc00/0xf569beb9d4b6a9fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6a9f5 expref: 20 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864037.487967:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e54357dc00/0xf569beb9d4b6a9fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a9f5 expref: 20 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864037.487978:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e54357dc00, rc 0) 00000100:00100000:0.0:1788864037.488100:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:22625:x1875759226683520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864037.488130:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788864037.488200:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226683520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864037.488220:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a9fc expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864037.488230:0:22625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6a9fc expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864037.488297:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226683648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788864037.488345:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864037.488398:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226683648 00000100:00100000:0.0:1788864037.488400:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d8780 going to sleep for 11 seconds 00000100:00100000:2.0:1788864037.488416:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226683648 00000100:00100000:2.0:1788864037.488485:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788864037.488495:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:22625:x1875759226683648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788864037.488520:0:22621:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788864037.488547:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788864037.488550:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788864037.488712:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:22625:x1875759226683648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 218us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864037.488722:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788864037.489996:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226683648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788864037.490272:0:22625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788864037.490293:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a9fc expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864037.490309:0:22625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a9fc expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788864037.490323:0:22625:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788864037.490328:0:22625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e680890800 from 13 10000000:01000000:0.0:1788864037.490332:0:22625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788864037.490387:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864037.490400:0:22625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864037.490460:0:22625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864037.490499:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226683776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788864037.490794:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864037.490877:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226683776 00000100:00100000:0.0:1788864037.490885:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788864037.490894:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226683776 00000100:00100000:3.0:1788864037.490978:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788864037.491016:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:22625:x1875759226683776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864037.491038:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864037.491062:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e64167cc00/0xf569beb9d4b6aa0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6aa03 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864037.491128:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167cc00/0xf569beb9d4b6aa0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6aa03 expref: 21 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864037.491141:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e64167cc00/0xf569beb9d4b6aa0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6aa03 expref: 21 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864037.491151:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e64167cc00, rc 0) 00000100:00100000:3.0:1788864037.491228:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:22625:x1875759226683776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864037.491235:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788864037.492685:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226683776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864037.492721:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6aa0a expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864037.492737:0:22625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6aa0a expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864037.492848:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226683904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788864037.500366:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864037.500439:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788864037.500766:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226683904 00000100:00100000:0.0:1788864037.500777:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226683904 00000100:00100000:0.0:1788864037.500831:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788864037.500839:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:22625:x1875759226683904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788864037.500864:0:22622:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788864037.500890:0:22622:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788864037.500892:0:22622:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788864037.501253:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:22625:x1875759226683904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 413us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864037.501261:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788864037.501344:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226683904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788864037.501415:0:22625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788864037.501425:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6aa0a expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864037.501442:0:22625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6aa0a expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864037.547369:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864038.379807:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226684032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788864038.379897:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864038.380303:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226684032 00000100:00100000:0.0:1788864038.380318:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226684032 00000100:00100000:0.0:1788864038.380376:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788864038.380388:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226684032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788864038.380422:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788864038.380480:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226684032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864038.380484:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226684160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788864038.380491:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788864038.380526:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864038.380578:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226684160 00000100:00100000:2.0:1788864038.380583:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226684160 00000100:00100000:2.0:1788864038.380613:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788864038.380624:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226684032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788864038.380625:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226684160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788864038.380652:0:23371:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788864038.380771:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226684160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864038.380773:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226684160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788864038.380786:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1788864038.571221:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788864039.276983:0:23385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788864039.595923:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864040.622068:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788864041.451349:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864041.451355:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788864041.451358:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864041.451360:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788864041.451381:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864041.451384:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788864041.451387:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864041.451389:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788864041.451435:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226684416:0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.451518:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864041.451576:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226684928:0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.451606:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864041.451631:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788864041.451637:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226684288:0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.451664:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864041.451685:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226684800:0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.451706:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864041.451734:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226684544:0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.451756:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864041.451772:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226685056:0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.451809:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864041.451821:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864041.451827:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226684672:0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.451846:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864041.451878:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226684416 00000100:00100000:2.0:1788864041.451886:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226684416 00000100:00100000:2.0:1788864041.451938:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226684672 00000100:00100000:2.0:1788864041.451941:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226684672 00000100:00100000:2.0:1788864041.451957:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788864041.451965:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226684416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.452020:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226684416:12345-0@lo:400:kworker.0 Request processed in 55us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864041.452027:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788864041.452043:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788864041.452048:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226684672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.452112:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226684672:12345-0@lo:400:kworker.0 Request processed in 63us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864041.452118:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788864041.452139:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226684928 00000100:00100000:2.0:1788864041.452287:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226684928 00000100:00100000:2.0:1788864041.452328:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226684800 00000100:00100000:2.0:1788864041.452331:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226684800 00000100:00100000:2.0:1788864041.452343:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226684544 00000100:00100000:2.0:1788864041.452346:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226684544 00000100:00100000:2.0:1788864041.452357:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226685056 00000100:00100000:2.0:1788864041.452360:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226685056 00000100:00100000:2.0:1788864041.452377:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788864041.452383:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226684928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.452418:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875759226684928:12345-0@lo:400:kworker.0 Request processed in 35us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864041.452424:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788864041.452437:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788864041.452443:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226684800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.452470:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875759226684800:12345-0@lo:400:kworker.0 Request processed in 27us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864041.452476:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788864041.452486:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788864041.452492:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226684544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.452519:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226684544:12345-0@lo:400:kworker.0 Request processed in 27us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864041.452525:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788864041.452536:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788864041.452550:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226685056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.452580:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875759226685056:12345-0@lo:400:kworker.0 Request processed in 32us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864041.452586:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788864041.452637:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226684672:0@lo:400:kworker.0 00010000:00080000:2.0:1788864041.452650:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af54e00 x1875759226684544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864041.452659:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226684544:0@lo:400:kworker.0 00010000:00080000:2.0:1788864041.452668:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af56d80 x1875759226685056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864041.452675:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875759226685056:0@lo:400:kworker.0 00010000:00080000:2.0:1788864041.452711:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af54000 x1875759226684800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864041.452719:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875759226684800:0@lo:400:kworker.0 00000100:00100000:2.0:1788864041.452728:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226684416:0@lo:400:kworker.0 00010000:00080000:2.0:1788864041.452736:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af55f80 x1875759226684928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864041.452742:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875759226684928:0@lo:400:kworker.0 00000100:00100000:3.0:1788864041.452920:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226684288 00000100:00100000:3.0:1788864041.452924:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226684288 00000100:00100000:3.0:1788864041.452963:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788864041.452971:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:3641:x1875759226684288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864041.453012:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:3641:x1875759226684288:12345-0@lo:400:kworker.0 Request processed in 43us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864041.453019:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788864041.453053:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226684288:0@lo:400:kworker.0 00000100:00080000:1.0:1788864041.453540:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788864041.453545:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788864041.643281:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864042.091250:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864027/real 1788864027] req@ffff89e5438df800 x1875759226677504/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864042.091289:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e5438df800 x1875759226677504/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864042.091317:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864027/real 1788864027] req@ffff89e5438de300 x1875759226677632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864042.091332:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e5438de300 x1875759226677632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788864042.091355:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67c44e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788864042.091372:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788864042.091376:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226677504:0@lo:8:kworker.0 00000100:00080000:2.0:1788864042.091381:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544143000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788864042.091387:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788864042.091390:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226677632:0@lo:8:kworker.0 00000100:00080000:0.0:1788864042.091629:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864042.091634:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788864042.091637:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864042.091640:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788864042.091654:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864042.091657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788864042.091660:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e67c44e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788864042.091665:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 694 00000100:00080000:0.0:1788864042.091671:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788864042.091682:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff89e67c44e000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788864042.091704:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438ddc00 x1875759226685696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788864042.091719:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788864042.091722:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788864042.091729:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e544143000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788864042.091733:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 694 00000100:00080000:0.0:1788864042.091736:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788864042.091741:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e544143000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788864042.091754:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5438df100 x1875759226685824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788864042.091817:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226685568:0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.091886:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864042.091932:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788864042.091939:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226685184:0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.091967:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864042.091998:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226685952:0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092023:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864042.092048:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226685312:0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092072:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864042.092114:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226686080:0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092154:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864042.092173:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788864042.092179:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226685440:0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092199:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864042.092215:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226686208:0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092233:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864042.092257:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226685568 00000100:00100000:0.0:1788864042.092265:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226685568 00000100:00100000:0.0:1788864042.092304:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226685312 00000100:00100000:0.0:1788864042.092314:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226685312 00000100:00100000:0.0:1788864042.092333:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788864042.092341:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226685568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092391:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226685568:12345-0@lo:400:kworker.0 Request processed in 50us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864042.092398:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788864042.092413:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788864042.092417:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226685312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092444:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226685312:12345-0@lo:400:kworker.0 Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864042.092449:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788864042.092464:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226685184 00000100:00100000:0.0:1788864042.092467:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226685184 00000100:00100000:0.0:1788864042.092488:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788864042.092494:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:3642:x1875759226685184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092519:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:3642:x1875759226685184:12345-0@lo:400:kworker.0 Request processed in 25us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864042.092525:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788864042.092551:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226685952 00000100:00100000:0.0:1788864042.092554:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226685952 00000100:00100000:0.0:1788864042.092571:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226686080 00000100:00100000:0.0:1788864042.092574:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226686080 00000100:00100000:0.0:1788864042.092584:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226685440 00000100:00100000:0.0:1788864042.092586:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226685440 00000100:00100000:0.0:1788864042.092596:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226686208 00000100:00100000:0.0:1788864042.092598:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226686208 00000100:00100000:0.0:1788864042.092609:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788864042.092615:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226685952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092659:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226685952:12345-0@lo:400:kworker.0 Request processed in 45us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864042.092665:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788864042.092678:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788864042.092682:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226686080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092705:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226686080:12345-0@lo:400:kworker.0 Request processed in 22us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864042.092710:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788864042.092719:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788864042.092724:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226685440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092746:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226685440:12345-0@lo:400:kworker.0 Request processed in 22us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864042.092757:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788864042.092768:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788864042.092773:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226686208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092795:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226686208:12345-0@lo:400:kworker.0 Request processed in 22us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864042.092800:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788864042.092847:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5438df800 x1875759226685440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864042.092860:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226685440:0@lo:400:kworker.0 00010000:00080000:0.0:1788864042.092871:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5438ded80 x1875759226686208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864042.092879:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226686208:0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092908:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226685312:0@lo:400:kworker.0 00010000:00080000:0.0:1788864042.092918:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5438dc000 x1875759226686080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864042.092926:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226686080:0@lo:400:kworker.0 00000100:00100000:0.0:1788864042.092952:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226685696:0@lo:8:kworker.0 00000100:00100000:0.0:1788864042.092999:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864042.093029:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226685824:0@lo:8:kworker.0 00000100:00100000:0.0:1788864042.093052:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864042.093109:0:24137:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226685696 00000100:00100000:0.0:1788864042.093114:0:24137:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226685696 00000100:00100000:0.0:1788864042.093136:0:24137:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226685824 00000100:00100000:0.0:1788864042.093139:0:24137:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226685824 00000100:00100000:0.0:1788864042.093149:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788864042.093153:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875759226685696:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788864042.093182:0:24137:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 709 last 0 00000020:00000080:0.0:1788864042.093213:0:24137:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b6aa11 00002000:00100000:0.0:1788864042.093228:0:24137:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff89e544895800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788864042.093232:0:24137:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788864042.093234:0:24137:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788864042.093406:0:24137:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788864042.093434:0:24137:0:(import.c:65:import_set_state_nolock()) ffff89e544897000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788864042.093475:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1875759226685696:12345-0@lo:8:kworker.0 Request processed in 320us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864042.093480:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788864042.093494:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864042.093506:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875759226685824:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788864042.093519:0:24137:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788864042.109768:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226685184:0@lo:400:kworker.0 00010000:00080000:1.0:1788864042.109809:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5438dc700 x1875759226685952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864042.109843:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226685952:0@lo:400:kworker.0 00000100:00100000:1.0:1788864042.109860:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226685568:0@lo:400:kworker.0 00010000:00080000:1.0:1788864042.109936:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5438ddc00 x1875759226685696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788864062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864042.109943:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788864042.109952:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788864042.109959:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788864042.109965:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788864042.109969:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67c44e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788864042.110293:0:23373:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788864042.110315:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543925c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23373:1875759226686464:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788864042.110383:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864042.110410:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5410eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788864042.110431:0:24136:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788864042.110437:0:24136:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788864042.110526:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788864042.110535:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226686336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788864042.110559:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864042.118275:0:24139:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226686336 00000100:00100000:0.0:1788864042.118292:0:24139:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226686336 00000100:00100000:0.0:1788864042.118363:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788864042.118373:0:24139:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875759226686336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788864042.118405:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788864042.118490:0:24139:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875759226686336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (7929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864042.118497:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788864042.119228:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875759226685824:12345-0@lo:8:kworker.0 Request processed in 25037us (25490us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788864042.119238:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864042.119259:0:24137:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226686464 00000100:00100000:0.0:1788864042.119263:0:24137:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226686464 00000100:00100000:0.0:1788864042.119297:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788864042.119303:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23373:x1875759226686464:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:3.0:1788864042.119994:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543924a80 x1875759226686336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864042.120017:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226686336:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788864042.121211:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788864042.125050:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788864042.125065:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226685696:0@lo:8:kworker.0 00000004:00080000:2.0:1788864042.125228:0:23372:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788864042.125312:0:23372:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 709249235605ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788864042.125319:0:23372:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:1.0:1788864042.127029:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544143000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864042.127039:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788864042.127044:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226685824:0@lo:8:kworker.0 00000004:00080000:2.0:1788864042.129963:0:23362:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788864042.131991:0:24137:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788864042.132000:0:24137:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00010000:00080000:1.0:1788864042.132271:0:23373:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543925c00 x1875759226686464/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788864058 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864042.132288:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543925c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23373:1875759226686464:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788864042.132301:0:23373:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788864042.132345:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23373:1875759226686592:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788864042.132381:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864042.132403:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e649bdecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864042.132455:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226686592 00000100:00100000:1.0:1788864042.132461:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226686592 00000100:00100000:1.0:1788864042.132518:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864042.132527:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:23373:x1875759226686592:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788864042.132565:0:24138:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788864042.132595:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:23373:x1875759226686592:12345-0@lo:5:osp-pre-0-1.0 Request processed in 69us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864042.132603:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788864042.132631:0:23373:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e54408ed80 x1875759226686592/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788864058 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864042.132641:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23373:1875759226686592:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788864042.132649:0:23373:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788864042.132670:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23373:1875759226686720:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788864042.132689:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864042.132702:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e649bdecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864042.132712:0:24435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226686720 00000100:00100000:1.0:1788864042.132715:0:24435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226686720 00000100:00100000:1.0:1788864042.132735:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788864042.132739:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:23373:x1875759226686720:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788864042.132786:0:24138:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:0.0:1788864042.134261:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:23373:x1875759226686464:12345-0@lo:7:osp-pre-0-1.0 Request processed in 14952us (23871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864042.134271:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000001:00080000:3.0:1788864042.164841:0:24132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1788864042.164856:0:24132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788864042.166352:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23373:x1875759226686720:12345-0@lo:5:osp-pre-0-1.0 Request processed in 33603us (33654us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788864042.166366:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788864042.170421:0:23373:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e54408ed80 x1875759226686720/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788864058 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864042.170438:0:23373:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788864042.170444:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23373:1875759226686720:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788864042.170459:0:23373:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1788864042.170513:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23373:1875759226686848:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788864042.170569:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864042.170806:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5410eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788864042.173813:0:22640:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226686848 00000100:00100000:1.0:1788864042.173827:0:22640:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226686848 00000100:00100000:1.0:1788864042.173880:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788864042.173889:0:22640:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23373:x1875759226686848:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788864042.173993:0:22640:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23373:x1875759226686848:12345-0@lo:900:osp-pre-0-1.0 Request processed in 106us (3424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864042.174000:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788864042.174249:0:23373:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e543924a80 x1875759226686848/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788864058 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864042.174265:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543924a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23373:1875759226686848:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788864042.668933:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788864043.436663:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788864043.490473:0:24501:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788864043.499296:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226686976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788864043.499383:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864043.499439:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226686976 00000100:00100000:0.0:1788864043.499447:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226686976 00000100:00100000:0.0:1788864043.499490:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788864043.499498:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226686976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788864043.499546:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788864043.499593:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226686976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864043.499600:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788864043.499646:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226686976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788864043.499826:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788864043.499836:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226687104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788864043.499875:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864043.499903:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226687104 00000100:00100000:1.0:1788864043.499907:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226687104 00000100:00100000:1.0:1788864043.499931:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788864043.499937:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226687104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788864043.499957:0:23371:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788864043.499990:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226687104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864043.499996:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788864043.500030:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226687104:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788864043.698363:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788864044.528732:0:24554:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788864044.528949:0:24554:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788864044.717177:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788864045.560693:0:24604:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788864045.560924:0:24604:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788864045.739550:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864046.188176:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864026/real 1788864026] req@ffff89e67af57480 x1875759226676096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864046 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864046.188211:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e67af57480 x1875759226676096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864046 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864046.188222:0:3639:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788864026/real 1788864026] req@ffff89e543926d80 x1875759226675968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864046 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864046.188242:0:3639:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e543926d80 x1875759226675968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788864046 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788864046.188261:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67c45b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864046.188294:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788864046.188298:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226676096:0@lo:8:kworker.0 00000100:00080000:1.0:1788864046.188321:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544177000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864046.188326:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788864046.188329:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226675968:0@lo:8:kworker.0 00000100:00080000:2.0:1788864046.188501:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864046.188506:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788864046.188508:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e544177000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788864046.188513:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 693 00000100:00080000:2.0:1788864046.188518:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788864046.188528:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89e544177000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788864046.188545:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5428aa300 x1875759226687488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788864046.188567:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864046.188570:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788864046.188571:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e67c45b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788864046.188574:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 693 00000100:00080000:2.0:1788864046.188577:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788864046.188581:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e67c45b800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788864046.188593:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5428aa680 x1875759226687616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788864046.188616:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788864046.188618:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788864046.188620:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e544143000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788864046.188623:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 709 00000100:00080000:2.0:1788864046.188626:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788864046.188629:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e544143000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:2.0:1788864046.188637:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5428a8700 x1875759226688128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788864046.188681:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226687872:0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.188748:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864046.188794:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226688512:0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.188825:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864046.188845:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788864046.188858:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226687232:0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.188881:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864046.188907:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226688000:0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.188930:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864046.188950:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226687360:0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.188969:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864046.188981:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226688256:0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.188998:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864046.189019:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788864046.189263:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226687744:0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.189286:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864046.189301:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226688384:0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.189315:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864046.189341:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226687872 00000100:00100000:2.0:1788864046.189349:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226687872 00000100:00100000:2.0:1788864046.189380:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226687360 00000100:00100000:2.0:1788864046.189382:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226687360 00000100:00100000:2.0:1788864046.189397:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788864046.189404:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226687872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.189464:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226687872:12345-0@lo:400:kworker.0 Request processed in 60us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864046.189471:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788864046.189485:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788864046.189490:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226687360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.189514:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226687360:12345-0@lo:400:kworker.0 Request processed in 24us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864046.189519:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788864046.189534:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226688512 00000100:00100000:2.0:1788864046.189541:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226688512 00000100:00100000:2.0:1788864046.189572:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226688256 00000100:00100000:2.0:1788864046.189574:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226688256 00000100:00100000:2.0:1788864046.189582:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226687744 00000100:00100000:2.0:1788864046.189584:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226687744 00000100:00100000:2.0:1788864046.189591:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226688384 00000100:00100000:2.0:1788864046.189593:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226688384 00000100:00100000:2.0:1788864046.189605:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788864046.189610:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226688512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.189635:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226688512:12345-0@lo:400:kworker.0 Request processed in 26us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864046.189641:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788864046.189650:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788864046.189654:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226688256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.189672:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226688256:12345-0@lo:400:kworker.0 Request processed in 18us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864046.189677:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788864046.189685:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788864046.189689:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226687744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.189954:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226687744:12345-0@lo:400:kworker.0 Request processed in 263us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864046.189960:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788864046.189974:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788864046.189979:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226688384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.190004:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226688384:12345-0@lo:400:kworker.0 Request processed in 25us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864046.190009:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788864046.190044:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226687232 00000100:00100000:2.0:1788864046.190048:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226687232 00000100:00100000:2.0:1788864046.190095:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788864046.190102:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:3640:x1875759226687232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.190132:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:3640:x1875759226687232:12345-0@lo:400:kworker.0 Request processed in 31us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864046.190138:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1788864046.190185:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428a9880 x1875759226687744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864046.190198:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226687744:0@lo:400:kworker.0 00010000:00080000:2.0:1788864046.190209:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428a8000 x1875759226688384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864046.190217:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226688384:0@lo:400:kworker.0 00000100:00100000:2.0:1788864046.190226:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226687360:0@lo:400:kworker.0 00000100:00100000:1.0:1788864046.190335:0:24435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226688000 00000100:00100000:1.0:1788864046.190339:0:24435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226688000 00000100:00100000:1.0:1788864046.190372:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864046.190379:0:24435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226688000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864046.190419:0:24435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226688000:12345-0@lo:400:kworker.0 Request processed in 42us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864046.190425:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788864046.190456:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226687488:0@lo:8:kworker.0 00000100:00100000:1.0:1788864046.190482:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864046.190504:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226687616:0@lo:8:kworker.0 00000100:00100000:1.0:1788864046.190521:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864046.190535:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226688128:0@lo:8:kworker.0 00000100:00100000:1.0:1788864046.190553:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864046.190576:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226687488 00000100:00100000:1.0:1788864046.190580:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226687488 00000100:00100000:1.0:1788864046.190595:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226687616 00000100:00100000:1.0:1788864046.190598:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226687616 00000100:00100000:1.0:1788864046.190604:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226688128 00000100:00100000:1.0:1788864046.190606:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226688128 00000100:00100000:1.0:1788864046.190614:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864046.190618:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226687488:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788864046.190656:0:24136:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:1.0:1788864046.190685:0:24136:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b6aa18 00002000:00100000:1.0:1788864046.190718:0:24136:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89e67e23c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788864046.190722:0:24136:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788864046.190725:0:24136:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788864046.190802:0:24136:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788864046.190836:0:24136:0:(import.c:65:import_set_state_nolock()) ffff89e67e239800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864046.191015:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1875759226687488:12345-0@lo:8:kworker.0 Request processed in 395us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864046.191023:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864046.191038:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788864046.191043:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226687616:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788864046.191057:0:24136:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788864046.191105:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226687616:12345-0@lo:8:kworker.0 Request processed in 62us (583us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788864046.191110:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788864046.191123:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788864046.191126:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226688128:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788864046.191135:0:24136:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788864046.191157:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226688128:12345-0@lo:8:kworker.0 Request processed in 29us (603us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788864046.191163:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788864046.191199:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428aa300 x1875759226687488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788864071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864046.191207:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788864046.191214:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788864046.191221:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788864046.191307:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788864046.191310:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544177000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788864046.191325:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788864046.191330:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226687488:0@lo:8:kworker.0 00000100:00080000:1.0:1788864046.191343:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67c45b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864046.191347:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788864046.191350:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226687616:0@lo:8:kworker.0 00000100:00080000:1.0:1788864046.191358:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544143000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864046.191361:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788864046.191363:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226688128:0@lo:8:kworker.0 00010000:00080000:2.0:1788864046.191925:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428a8e00 x1875759226688256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864046.191936:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226688256:0@lo:400:kworker.0 00000004:00080000:2.0:1788864046.192001:0:22653:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:2.0:1788864046.192021:0:22653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22653:1875759226688768:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788864046.192055:0:22653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864046.192072:0:22653:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64ae22480 going to sleep for 11 seconds 00000100:00080000:3.0:1788864046.192217:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788864046.192223:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788864046.192225:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788864046.192571:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226687232:0@lo:400:kworker.0 00010000:00080000:3.0:1788864046.192585:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428ab100 x1875759226688000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788864062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864046.192593:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226688000:0@lo:400:kworker.0 00000100:00100000:3.0:1788864046.192603:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226687872:0@lo:400:kworker.0 00010000:00080000:3.0:1788864046.192617:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428abb80 x1875759226688512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864046.192624:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226688512:0@lo:400:kworker.0 00000100:00100000:1.0:1788864046.192800:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226688640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788864046.192846:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864046.193342:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226688768 00000100:00100000:1.0:1788864046.193349:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226688768 00000100:00100000:1.0:1788864046.193396:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788864046.193404:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22653:x1875759226688768:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788864046.193469:0:24139:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226688640 00000100:00100000:0.0:1788864046.193474:0:24139:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226688640 00000100:00100000:0.0:1788864046.193500:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788864046.193506:0:24139:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875759226688640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788864046.193522:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788864046.193565:0:24139:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875759226688640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864046.193571:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788864046.193604:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e67af54e00 x1875759226688640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864046.193619:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226688640:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788864046.194005:0:22652:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788864046.194109:0:22652:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 713318032054ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788864046.194116:0:22652:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:3.0:1788864046.194799:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788864046.201960:0:24136:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788864046.201975:0:24136:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788864046.201983:0:24136:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:2.0:1788864046.202831:0:22608:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788864046.224047:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.224059:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b6aa1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.224090:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.224096:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.224103:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b6aa1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.224130:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b6aa1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.224140:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b6aa1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.224148:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b6aa1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.224167:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788864046.224180:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864046.224186:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b6aa1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.224193:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864046.224197:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b6aa1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.224206:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b6aa1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.224222:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b6aa1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.224229:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f689b4a/0xf569beb9d4b6aa1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.224254:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.224256:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.224258:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.226206:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.226221:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1ee863c/0xf569beb9d4b6aa26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.226238:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.226242:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.226247:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1ee863c/0xf569beb9d4b6aa26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.226261:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1ee863c/0xf569beb9d4b6aa26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.226271:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1ee863c/0xf569beb9d4b6aa26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.226279:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1ee863c/0xf569beb9d4b6aa26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.226300:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788864046.228112:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.228124:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aa2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.228144:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864046.228152:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1ee863c/0xf569beb9d4b6aa26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.228230:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640031400 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864046.228299:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1ee863c/0xf569beb9d4b6aa26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.228311:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1ee863c/0xf569beb9d4b6aa26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.228346:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1ee863c/0xf569beb9d4b6aa26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.228354:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1ee863c/0xf569beb9d4b6aa26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.228373:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.228374:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.228376:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.228674:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.228679:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.228685:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aa2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.228698:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aa2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.228708:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aa2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.228717:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aa2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.228738:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864046.229040:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864046.229047:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aa2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.229066:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864046.229070:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aa2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.229113:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aa2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.229127:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aa2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.229135:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aa2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.229150:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.229152:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.229153:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.229707:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.229715:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aa34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.229723:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.229728:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.229732:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aa34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.229743:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aa34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.229762:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aa34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.229770:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aa34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.229829:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864046.230445:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864046.230452:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aa34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.230462:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864046.230466:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aa34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.230474:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aa34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.230493:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aa34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.230500:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aa34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.230515:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.230517:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.230519:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.231751:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.231761:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aa3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.231774:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.231779:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.231784:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aa3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.231797:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aa3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.231822:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aa3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.231830:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aa3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.231864:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788864046.232175:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864046.232181:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aa3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.232190:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864046.232194:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aa3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.232202:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aa3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.232216:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aa3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.232223:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aa3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.232252:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.232254:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.232256:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.234767:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.234790:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aa42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.234807:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.234825:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.234832:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aa42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.234855:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aa42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.234866:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aa42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.234875:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aa42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.234900:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864046.234960:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864046.234968:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aa42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.234976:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864046.234980:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aa42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.234988:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aa42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.235005:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aa42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.235011:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aa42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.235051:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.235052:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.235054:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.236726:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.236738:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aa49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.236753:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.236771:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.236778:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aa49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.236792:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aa49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.236802:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aa49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.236809:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aa49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.236894:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864046.237303:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864046.237309:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aa49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.237318:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fc00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864046.237322:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aa49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.237330:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aa49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.237346:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aa49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.237353:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aa49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.237372:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.237374:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.237375:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.237477:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.237482:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.237488:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.237490:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.237493:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.237499:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.237504:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.237514:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.237528:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788864046.237623:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864046.237630:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.237637:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f400 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864046.237716:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.237725:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.237737:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.237745:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.237759:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.237761:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.237763:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.238330:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.238338:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aa57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.238348:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.238351:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.238356:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aa57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.238365:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aa57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.238374:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aa57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.238387:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aa57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.238442:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864046.238474:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864046.238479:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aa57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.238498:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ec00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864046.238502:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aa57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.238510:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aa57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.238522:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aa57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.238529:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aa57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.238544:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.238545:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.238547:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.238760:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.238765:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aa5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.238785:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.238787:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.238790:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aa5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.238797:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aa5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.238802:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aa5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.238807:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aa5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.238835:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864046.239296:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864046.239302:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aa5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.239310:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864046.239313:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aa5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.239321:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aa5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.239342:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aa5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.239349:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aa5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.239362:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.239364:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.239366:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.239436:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.239442:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aa65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.239451:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.239453:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.239457:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aa65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.239466:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aa65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.239484:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aa65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.239490:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aa65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.239542:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788864046.239671:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864046.239677:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aa65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.239694:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ea00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864046.239698:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aa65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.239705:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aa65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.239717:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aa65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.239724:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aa65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.239737:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.239739:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.239741:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.240861:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.240874:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6aa6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.240890:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.240894:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.240899:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6aa6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.240912:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6aa6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.240925:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6aa6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.240933:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6aa6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.240968:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864046.241322:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864046.241329:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6aa6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.241339:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ee00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864046.241345:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6aa6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.241353:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6aa6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.241367:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6aa6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.241375:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021414597/0xf569beb9d4b6aa6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.241467:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.241470:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.241471:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.241688:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.241694:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a4bd75/0xf569beb9d4b6aa73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.241703:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.241712:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.241716:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a4bd75/0xf569beb9d4b6aa73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.241726:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a4bd75/0xf569beb9d4b6aa73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.241733:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a4bd75/0xf569beb9d4b6aa73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.241739:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a4bd75/0xf569beb9d4b6aa73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.241762:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864046.241914:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864046.241921:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a4bd75/0xf569beb9d4b6aa73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.241930:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fe00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864046.241934:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a4bd75/0xf569beb9d4b6aa73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.241943:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a4bd75/0xf569beb9d4b6aa73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.241956:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a4bd75/0xf569beb9d4b6aa73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.241964:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a4bd75/0xf569beb9d4b6aa73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.241979:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.241981:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.241983:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.242533:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.242539:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aa7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.242556:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.242559:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.242562:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aa7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.242570:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aa7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.242575:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aa7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.242581:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aa7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.242592:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788864046.242617:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864046.242623:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aa7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.242630:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864046.242634:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aa7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.242654:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aa7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.242671:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aa7a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.242678:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aa7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.242695:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.242697:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.242698:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.243217:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.243223:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b6aa81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.243231:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.243234:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.243238:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b6aa81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.243248:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b6aa81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.243268:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b6aa81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.243275:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b6aa81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.243356:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788864046.243366:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864046.243372:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b6aa81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.243379:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e400 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788864046.243383:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b6aa81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.243400:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b6aa81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.243415:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b6aa81 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.243422:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db9097b9/0xf569beb9d4b6aa81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.243436:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864046.243438:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864046.243439:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.243655:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.243661:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aa88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.243669:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.243672:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.243676:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aa88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.243685:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aa88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.243693:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aa88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.243701:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aa88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.243733:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864046.243871:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864046.243878:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aa88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.243886:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fa00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864046.243896:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aa88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.243904:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aa88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.243922:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aa88 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.243930:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aa88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.243944:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.243946:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.243948:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.244182:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.244188:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aa8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.244196:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.244199:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.244203:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aa8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.244212:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aa8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.244220:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aa8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.244227:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aa8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.244246:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788864046.244312:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864046.244318:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aa8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.244325:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864046.244329:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aa8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.244337:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aa8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.244349:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aa8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.244356:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aa8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.244383:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.244385:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.244387:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.244582:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.244587:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050cf16c5/0xf569beb9d4b6aa96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.244595:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.244603:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.244608:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050cf16c5/0xf569beb9d4b6aa96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.244616:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050cf16c5/0xf569beb9d4b6aa96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.244624:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050cf16c5/0xf569beb9d4b6aa96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.244630:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050cf16c5/0xf569beb9d4b6aa96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.244647:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788864046.244949:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.244955:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.244964:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.244967:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.244971:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.244982:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.244989:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.245001:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.245021:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788864046.245178:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788864046.245185:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050cf16c5/0xf569beb9d4b6aa96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.245194:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788864046.245198:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050cf16c5/0xf569beb9d4b6aa96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.245219:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050cf16c5/0xf569beb9d4b6aa96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.245234:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050cf16c5/0xf569beb9d4b6aa96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.245242:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050cf16c5/0xf569beb9d4b6aa96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.245259:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864046.245263:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.245272:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f400 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788864046.245276:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.245284:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.245293:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.245300:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eb51c03/0xf569beb9d4b6aa9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.245354:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.245357:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.245358:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.245392:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.245397:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aaa4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.245405:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.245407:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.245411:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aaa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.245419:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aaa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.245426:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aaa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.245433:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aaa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.245450:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788864046.245558:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864046.245564:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aaa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.245572:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864046.245575:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aaa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.245583:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aaa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.245595:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aaa4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.245602:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aaa4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.245616:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.245618:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.245620:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.245792:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.245798:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aaab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.245801:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.245806:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.245823:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.245828:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aaab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.245837:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aaab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.245845:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aaab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.245852:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aaab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.245875:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788864046.246254:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864046.246261:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aaab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.246269:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788864046.246273:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aaab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.246281:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aaab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.246292:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aaab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.246300:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a82a6cf4/0xf569beb9d4b6aaab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.246312:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864046.246313:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864046.246315:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.246395:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.246400:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aab2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.246408:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.246410:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.246414:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aab2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.246433:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aab2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.246440:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aab2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.246447:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aab2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.246465:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788864046.247695:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864046.247717:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aab2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.247745:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864046.247749:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aab2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.247758:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aab2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.247774:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aab2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.247781:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049e808de/0xf569beb9d4b6aab2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.247801:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.247803:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.247804:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.248247:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.248255:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aab9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.248266:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.248270:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.248277:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aab9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.248289:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aab9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.248299:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aab9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.248319:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aab9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.248340:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864046.248360:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864046.248366:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aab9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.248373:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864046.248376:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aab9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.248383:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aab9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.248394:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aab9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.248406:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c45a2185/0xf569beb9d4b6aab9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.248420:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.248422:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.248424:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.248909:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.248917:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aac0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.248926:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.248930:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.248934:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aac0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.248943:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aac0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.248951:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aac0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.248959:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aac0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.248980:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788864046.249003:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864046.249009:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aac0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.249016:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ea00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788864046.249026:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aac0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.249034:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aac0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.249046:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aac0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.249054:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a542913/0xf569beb9d4b6aac0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.249220:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864046.249222:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864046.249224:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864046.249459:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.249466:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aac7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.249484:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.249487:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.249490:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aac7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.249499:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aac7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.249507:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aac7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.249514:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aac7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.249565:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788864046.249929:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.249936:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aace lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.249944:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.249947:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.249951:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aace lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.249960:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aace lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.249980:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aace lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.249988:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aace lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.250070:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788864046.250126:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aac7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.250135:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864046.250146:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aac7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.250156:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.250176:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aac7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.250183:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6aac7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.250199:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864046.250203:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aace lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.250210:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ec00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864046.250213:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aace lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.250221:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aace lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.250229:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aace lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.250237:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.250239:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.250240:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.250642:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788864046.250648:0:24136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c01ebbf/0xf569beb9d4b6aace lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788864046.251546:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.251556:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aad5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.251570:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.251575:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.251581:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aad5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.251594:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aad5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.251615:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aad5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.251637:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aad5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.251800:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864046.251808:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aad5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.251825:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fc00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864046.251830:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aad5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.251839:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aad5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.251853:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aad5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.251861:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.251863:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.251865:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.251997:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788864046.252005:0:24136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008965e80e/0xf569beb9d4b6aad5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788864046.252527:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.252534:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aadc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.252545:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.252548:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.252553:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aadc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.252565:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aadc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.252573:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aadc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.252581:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aadc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.252696:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864046.252866:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aadc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.252874:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788864046.252878:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aadc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.252887:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aadc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.252900:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aadc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.252916:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864046.252917:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864046.252919:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.252979:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788864046.252984:0:24136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6aadc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788864046.253885:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.253894:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aae3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.253907:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.253911:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.253916:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aae3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.253928:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aae3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.253938:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aae3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.253945:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aae3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.254415:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864046.254423:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aae3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.254446:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864046.254451:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aae3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.254460:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aae3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.254474:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aae3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864046.254482:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.254484:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864046.254486:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.254575:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788864046.254581:0:24136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccaafe72/0xf569beb9d4b6aae3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788864046.255153:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.255160:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aaea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.255170:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.255174:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.255180:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aaea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.255191:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aaea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.255200:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aaea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.255208:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aaea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.255320:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864046.255326:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aaea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.255345:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864046.255348:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aaea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.255356:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aaea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.255367:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aaea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864046.255375:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.255377:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864046.255379:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.255496:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788864046.255501:0:24136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aaea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788864046.255918:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864046.255924:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aaf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.255943:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1788864046.255947:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864046.255952:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aaf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.255963:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aaf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.255970:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aaf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864046.255976:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aaf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.256008:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864046.256014:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aaf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.256021:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fa00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788864046.256024:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aaf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.256032:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aaf1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.256044:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aaf1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864046.256053:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864046.256054:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864046.256056:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864046.256308:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788864046.256313:0:24136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c7c796f/0xf569beb9d4b6aaf1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788864046.256378:0:24136:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:1.0:1788864046.256480:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22653:x1875759226688768:12345-0@lo:5:osp-pre-0-0.0 Request processed in 63072us (64420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864046.256492:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788864046.256608:0:22653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af57100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22653:1875759226688768:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788864046.256626:0:22653:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:2.0:1788864046.256675:0:22653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22653:1875759226688896:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788864046.256859:0:22653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864046.256897:0:22653:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64ae22480 going to sleep for 11 seconds 00000100:00100000:1.0:1788864046.256953:0:24137:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226688896 00000100:00100000:1.0:1788864046.256960:0:24137:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226688896 00000100:00100000:1.0:1788864046.257010:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788864046.257020:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22653:x1875759226688896:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788864046.257066:0:24137:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:3.0:1788864046.259270:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788864046.263446:0:24132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1788864046.263498:0:24132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788864046.263932:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22653:x1875759226688896:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6908us (7067us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788864046.263946:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788864046.264016:0:22653:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788864046.264027:0:22653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22653:1875759226688896:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788864046.264045:0:22653:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:2.0:1788864046.764894:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864047.602409:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788864047.602434:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226689024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788864047.602506:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864047.602710:0:24139:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226689024 00000100:00100000:1.0:1788864047.602722:0:24139:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226689024 00000100:00100000:1.0:1788864047.602793:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788864047.602805:0:24139:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226689024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788864047.602850:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788864047.602899:0:24139:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226689024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864047.602906:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788864047.603102:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226689024:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788864047.787451:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864048.619280:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788864048.619308:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226689152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788864048.619393:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864048.619512:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226689152 00000100:00100000:3.0:1788864048.619521:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226689152 00000100:00100000:0.0:1788864048.621211:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788864048.621228:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226689280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788864048.621282:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864048.621377:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226689280 00000100:00100000:1.0:1788864048.621384:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226689280 00000100:00100000:1.0:1788864048.621431:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788864048.621442:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226689280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788864048.621477:0:23371:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788864048.621523:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226689280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864048.621529:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788864048.621780:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226689280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788864048.626033:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788864048.626047:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226689152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788864048.626111:0:22634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788864048.626208:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226689152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (6814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864048.626216:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788864048.626246:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226689152:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788864048.818884:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788864049.516671:0:23385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788864049.841103:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864050.861365:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864051.691589:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788864051.691631:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226689408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788864051.691750:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864051.692004:0:24139:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226689408 00000100:00100000:2.0:1788864051.692017:0:24139:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226689408 00000100:00100000:2.0:1788864051.692129:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788864051.692142:0:24139:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226689408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788864051.692193:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788864051.692252:0:24139:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226689408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864051.692259:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788864051.692757:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864051.692762:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788864051.692765:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e67c45b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788864051.692772:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 713 00000100:00080000:1.0:1788864051.692777:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788864051.692788:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e67c45b800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788864051.692834:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e54408d180 x1875759226689792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788864051.692885:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864051.692888:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788864051.692890:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e544143000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788864051.692894:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 713 00000100:00080000:1.0:1788864051.692896:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788864051.692903:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e544143000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788864051.692914:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e5428ab100 x1875759226690304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788864051.692960:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226689664:0@lo:400:kworker.0 00000100:00100000:1.0:1788864051.693007:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864051.693048:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226690432:0@lo:400:kworker.0 00000100:00100000:1.0:1788864051.693107:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864051.693132:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788864051.693137:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3643:1875759226689536:0@lo:400:kworker.0 00000100:00080000:3.0:1788864051.693763:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864051.693787:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226689920:0@lo:400:kworker.0 00000100:00100000:3.0:1788864051.693840:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864051.693875:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226690560:0@lo:400:kworker.0 00000100:00100000:3.0:1788864051.693906:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864051.693968:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226689408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788864051.693995:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788864051.694001:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226690048:0@lo:400:kworker.0 00000100:00100000:3.0:1788864051.694029:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864051.694051:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226690688:0@lo:400:kworker.0 00000100:00100000:3.0:1788864051.694071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864051.694125:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226689664 00000100:00100000:3.0:1788864051.694132:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226689664 00000100:00100000:3.0:1788864051.694189:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226690048 00000100:00100000:3.0:1788864051.694193:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226690048 00000100:00100000:3.0:1788864051.694212:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788864051.694221:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226689664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864051.694777:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226689664:12345-0@lo:400:kworker.0 Request processed in 554us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864051.694787:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788864051.694814:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788864051.694821:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226690048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864051.694859:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226690048:12345-0@lo:400:kworker.0 Request processed in 39us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864051.694866:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788864051.694908:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226690048:0@lo:400:kworker.0 00000100:00100000:0.0:1788864051.695013:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226690432 00000100:00100000:0.0:1788864051.695018:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226690432 00000100:00100000:0.0:1788864051.695044:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226689920 00000100:00100000:0.0:1788864051.695047:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226689920 00000100:00100000:0.0:1788864051.695059:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226690560 00000100:00100000:0.0:1788864051.695062:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226690560 00000100:00100000:0.0:1788864051.695130:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226690688 00000100:00100000:0.0:1788864051.695134:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226690688 00000100:00100000:0.0:1788864051.695164:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788864051.695175:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226690432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864051.695214:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226690432:12345-0@lo:400:kworker.0 Request processed in 40us (2140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864051.695220:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788864051.695235:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788864051.695240:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226689920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864051.695289:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226689920:12345-0@lo:400:kworker.0 Request processed in 48us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864051.695295:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788864051.695308:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788864051.695314:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226690560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864051.695343:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226690560:12345-0@lo:400:kworker.0 Request processed in 29us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864051.695350:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788864051.695362:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788864051.695367:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226690688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864051.695396:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226690688:12345-0@lo:400:kworker.0 Request processed in 28us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864051.695402:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788864051.695718:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864051.695769:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226690176:0@lo:400:kworker.0 00000100:00100000:1.0:1788864051.695803:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864051.695839:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226689664:0@lo:400:kworker.0 00010000:00080000:1.0:1788864051.695857:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428a8a80 x1875759226690432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864051.695870:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226690432:0@lo:400:kworker.0 00000100:00100000:1.0:1788864051.695903:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226689792:0@lo:8:kworker.0 00000100:00100000:1.0:1788864051.695940:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864051.695961:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226690304:0@lo:8:kworker.0 00000100:00100000:1.0:1788864051.695981:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864051.696033:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226690176 00000100:00100000:1.0:1788864051.696038:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226690176 00000100:00100000:1.0:1788864051.696072:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226689792 00000100:00100000:1.0:1788864051.696094:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226689792 00000100:00100000:1.0:1788864051.696107:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226690304 00000100:00100000:1.0:1788864051.696109:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226690304 00000100:00100000:1.0:1788864051.696119:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788864051.696125:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226690176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864051.696177:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226690176:12345-0@lo:400:kworker.0 Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864051.696184:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788864051.696200:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788864051.696203:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875759226689792:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788864051.696226:0:24138:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788864051.696369:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788864051.696375:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788864051.696377:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788864051.696406:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428a8380 x1875759226690688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864051.696418:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226690688:0@lo:400:kworker.0 00010000:00080000:3.0:1788864051.696430:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e54408f100 x1875759226689920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864051.696438:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226689920:0@lo:400:kworker.0 00010000:00080000:3.0:1788864051.696450:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e5428a8e00 x1875759226690560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864051.696457:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226690560:0@lo:400:kworker.0 00000100:00100000:1.0:1788864051.696727:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875759226689792:12345-0@lo:8:kworker.0 Request processed in 53us (317us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788864051.696738:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788864051.696753:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788864051.696758:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875759226690304:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788864051.696770:0:24138:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788864051.696803:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875759226690304:12345-0@lo:8:kworker.0 Request processed in 44us (820us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788864051.696809:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788864051.696864:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67c45b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864051.696871:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788864051.696874:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226689792:0@lo:8:kworker.0 00000100:00080000:1.0:1788864051.696884:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544143000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864051.696888:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788864051.696891:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226690304:0@lo:8:kworker.0 00000100:00100000:1.0:1788864051.696926:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226690176:0@lo:400:kworker.0 00000100:00100000:0.0:1788864051.697024:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226689536 00000100:00100000:0.0:1788864051.697030:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226689536 00000100:00100000:0.0:1788864051.697116:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788864051.697124:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:3643:x1875759226689536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864051.697435:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:3643:x1875759226689536:12345-0@lo:400:kworker.0 Request processed in 310us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864051.697442:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788864051.697550:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3643:1875759226689536:0@lo:400:kworker.0 00010000:00010000:3.0:1788864051.884514:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864052.715893:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788864052.715935:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226690816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788864052.716015:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864052.716112:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226690816 00000100:00100000:3.0:1788864052.716120:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226690816 00000100:00100000:3.0:1788864052.716167:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788864052.716176:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226690816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788864052.716198:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788864052.716245:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226690816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864052.716252:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788864052.716301:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226690816:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788864052.908031:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788864053.216180:0:24949:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788864053.216184:0:24949:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788864053.216186:0:24949:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788864053.216763:0:24949:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89e5429b1000 00000020:01000004:3.0:1788864053.216783:0:24949:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788864053.216800:0:24949:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788864053.217035:0:24949:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff89e681bf8000) 00000020:00000080:3.0:1788864053.217059:0:24949:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788864053.277962:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788864053.279541:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788864053.280144:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788864053.280391:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788864053.280825:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788864053.293597:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788864053.298516:0:24949:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1788864053.307780:0:24949:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788864053.309865:0:24949:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788864053.309882:0:24949:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788864053.309897:0:24949:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf569beb9d4b6aaff 00000020:01000004:1.0:1788864053.309906:0:24949:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788864053.309929:0:24949:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788864053.309932:0:24949:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788864053.309938:0:24949:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788864053.309971:0:24949:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788864053.309975:0:24949:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.135@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788864053.345929:0:24949:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.135@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788864053.345972:0:24949:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.135@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788864053.345977:0:24949:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788864053.345979:0:24949:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788864053.345980:0:24949:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864053.345982:0:24949:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788864053.345983:0:24949:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864053.345984:0:24949:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864053.345986:0:24949:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788864053.345988:0:24949:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864053.345989:0:24949:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788864053.345992:0:24949:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788864053.345994:0:24949:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788864053.345996:0:24949:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788864053.346002:0:24949:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864053.346003:0:24949:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788864053.346004:0:24949:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864053.346005:0:24949:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864053.346006:0:24949:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788864053.346007:0:24949:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864053.346008:0:24949:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788864053.346037:0:24949:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788864053.346058:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226690944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788864053.346211:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864053.346256:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d59ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788864053.346543:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226690944 00000100:00100000:0.0:1788864053.346551:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226690944 00000100:00100000:0.0:1788864053.346619:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788864053.346629:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24949:x1875759226690944:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788864053.346658:0:22622:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788864053.346661:0:22622:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788864053.346665:0:22622:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788864053.347644:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24949:x1875759226690944:12345-0@lo:253:mount.lustre.0 Request processed in 1012us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864053.347655:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788864053.347807:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226690944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788864053.347820:0:24949:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788864053.347823:0:24949:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788864053.347825:0:24949:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788864053.347826:0:24949:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788864053.347828:0:24949:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788864053.347829:0:24949:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788864053.347830:0:24949:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788864053.347831:0:24949:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788864053.347833:0:24949:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788864053.347834:0:24949:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788864053.347856:0:24949:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e5429b1000 from lustre-OST0001 10000000:01000000:2.0:1788864053.347885:0:24949:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788864053.347889:0:24949:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788864053.347898:0:24949:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89e66c64b380 local copy 00010000:00010000:2.0:1788864053.347919:0:24949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a740 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864053.348011:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864053.348042:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864053.348100:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d59ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788864053.348238:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226691072 00000100:00100000:0.0:1788864053.348244:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226691072 00000100:00100000:0.0:1788864053.348271:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788864053.348278:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24949:x1875759226691072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864053.348351:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24949:x1875759226691072:12345-0@lo:501:mount.lustre.0 Request processed in 72us (307us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788864053.348359:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788864053.348606:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691072:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788864053.348633:0:24949:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.135@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788864053.348650:0:24949:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.135@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788864053.348656:0:24949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a740 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864053.348666:0:24949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e640030600/0xf569beb9d4b6a739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6a740 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864053.348706:0:24949:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e5429b1000 10000000:01000000:2.0:1788864053.348712:0:24949:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788864053.348717:0:24949:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788864053.348719:0:24949:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788864053.348724:0:24949:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788864053.348728:0:24949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788864053.348749:0:24949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e6808bc600/0xf569beb9d4b6ab06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864053.348757:0:24949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e6808bc600/0xf569beb9d4b6ab06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864053.348767:0:24949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e6808bc600/0xf569beb9d4b6ab06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864053.348780:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788864053.348806:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864053.348835:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d59ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788864053.349059:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226691200 00000100:00100000:0.0:1788864053.349064:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226691200 00000100:00100000:0.0:1788864053.349123:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788864053.349130:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:24949:x1875759226691200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864053.349139:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864053.349158:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e54357ce00/0xf569beb9d4b6ab0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6ab06 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864053.349180:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e54357ce00/0xf569beb9d4b6ab0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6ab06 expref: 22 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864053.349201:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e54357ce00/0xf569beb9d4b6ab0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6ab06 expref: 22 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864053.349210:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e54357ce00, rc 0) 00000100:00100000:0.0:1788864053.349249:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:24949:x1875759226691200:12345-0@lo:101:mount.lustre.0 Request processed in 119us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864053.349256:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788864053.349436:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864053.349450:0:24949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e6808bc600/0xf569beb9d4b6ab06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab0d expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.349459:0:24949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e6808bc600/0xf569beb9d4b6ab06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6ab0d expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788864053.351579:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1788864053.352699:0:24949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864053.356026:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788864053.356373:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788864053.356393:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788864053.356415:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788864053.356444:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788864053.356640:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788864053.356682:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788864053.356712:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788864053.356739:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1788864053.357026:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1788864053.357036:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788864053.357885:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864053.357976:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864053.358367:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d59ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788864053.358788:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226691328 00000100:00100000:0.0:1788864053.358798:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226691328 00000100:00100000:0.0:1788864053.360026:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788864053.360042:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:24949:x1875759226691328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788864053.360247:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:24949:x1875759226691328:12345-0@lo:501:mount.lustre.0 Request processed in 211us (2272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864053.360254:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788864053.360588:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864053.360637:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788864053.360696:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864053.361752:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226691456 00000100:00100000:2.0:1788864053.361763:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226691456 00000100:00100000:2.0:1788864053.361807:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788864053.361815:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:24949:x1875759226691456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788864053.362788:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:24949:x1875759226691456:12345-0@lo:503:mount.lustre.0 Request processed in 970us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864053.362799:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788864053.362990:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788864053.363017:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788864053.363716:0:24949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788864053.363805:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864053.363866:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864053.364025:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226691584 00000100:00100000:0.0:1788864053.364032:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226691584 00000100:00100000:2.0:1788864053.364382:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788864053.364393:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:24949:x1875759226691584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864053.364738:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5428029c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864053.364901:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:24949:x1875759226691584:12345-0@lo:502:mount.lustre.0 Request processed in 509us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864053.364918:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788864053.365065:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788864053.365400:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788864053.365429:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788864053.365443:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788864053.365456:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788864053.365470:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788864053.365484:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788864053.365498:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788864053.365512:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788864053.365539:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788864053.365636:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788864053.365693:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864053.365730:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5428029c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864053.365791:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226691712 00000100:00100000:2.0:1788864053.365797:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226691712 00000100:00100000:2.0:1788864053.365839:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788864053.365846:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:24949:x1875759226691712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864053.366058:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:24949:x1875759226691712:12345-0@lo:502:mount.lustre.0 Request processed in 212us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864053.366066:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788864053.366382:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788864053.366487:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788864053.366497:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788864053.367464:0:24954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788864053.367473:0:24954:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788864053.367480:0:24954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864053.367482:0:24954:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788864053.367488:0:24954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788864053.367509:0:24954:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff89e5428ecd40) 00000020:00000080:2.0:1788864053.367533:0:24954:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788864053.367540:0:24954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788864053.367699:0:24954:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e5429b1000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788864053.367708:0:24954:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788864053.367715:0:24954:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf569beb9d4b6ab1b 00010000:00010000:2.0:1788864053.373172:0:24954:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788864053.375067:0:24954:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1788864053.377775:0:24954:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788864053.379441:0:24954:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788864053.379453:0:24954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864053.379461:0:24954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864053.379463:0:24954:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788864053.379466:0:24954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864053.379470:0:24954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864053.379472:0:24954:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788864053.379475:0:24954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788864053.379477:0:24954:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788864053.379479:0:24954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864053.379481:0:24954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864053.379483:0:24954:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788864053.379485:0:24954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788864053.379487:0:24954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864053.379489:0:24954:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788864053.379492:0:24954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788864053.379518:0:24954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788864053.379521:0:24954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788864053.379523:0:24954:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788864053.379526:0:24954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788864053.382726:0:24949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788864053.382782:0:24949:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788864053.382857:0:24949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e6808bc600/0xf569beb9d4b6ab06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab0d expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.382879:0:24949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e6808bc600/0xf569beb9d4b6ab06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab0d expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864053.386275:0:24949:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e5429b1000 from 1 10000000:01000000:2.0:1788864053.386294:0:24949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788864053.386339:0:24949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864053.386362:0:24949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864053.386373:0:24949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864053.386400:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788864053.386473:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864053.386529:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864053.386734:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226691840 00000100:00100000:1.0:1788864053.386743:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226691840 00000100:00100000:1.0:1788864053.386797:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788864053.386807:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:24949:x1875759226691840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788864053.386819:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864053.386832:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6ab29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6ab22 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.386856:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6ab29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6ab22 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.386866:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6ab29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6ab22 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.386874:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fc00, rc 0) 00000100:00100000:1.0:1788864053.386925:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:24949:x1875759226691840:12345-0@lo:101:mount.lustre.0 Request processed in 120us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.386933:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788864053.387201:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788864053.387216:0:24949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab29 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864053.387225:0:24949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6ab29 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788864053.388632:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788864053.388904:0:24949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788864053.389513:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788864053.389544:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788864053.389630:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788864053.389652:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788864053.389666:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788864053.389692:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788864053.389706:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788864053.389721:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788864053.389735:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788864053.389748:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788864053.389772:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788864053.389790:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788864053.389795:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788864053.389882:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864053.390756:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864053.390802:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b622540 going to sleep for 11 seconds 00000100:00100000:3.0:1788864053.392852:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226691968 00000100:00100000:3.0:1788864053.392867:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226691968 00000100:00100000:3.0:1788864053.392933:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788864053.392943:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:24949:x1875759226691968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864053.393123:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:24949:x1875759226691968:12345-0@lo:501:mount.lustre.0 Request processed in 182us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864053.393131:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788864053.393725:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226691968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864053.393776:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788864053.393830:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864053.393875:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b622540 going to sleep for 11 seconds 00000100:00100000:3.0:1788864053.394138:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226692096 00000100:00100000:3.0:1788864053.394144:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226692096 00000100:00100000:3.0:1788864053.394177:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788864053.394185:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:24949:x1875759226692096:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788864053.394300:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:24949:x1875759226692096:12345-0@lo:503:mount.lustre.0 Request processed in 115us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864053.394307:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788864053.394507:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692096:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788864053.395104:0:24949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788864053.395177:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864053.395283:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864053.395389:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864053.395466:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226692224 00000100:00100000:1.0:1788864053.395472:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226692224 00000100:00100000:1.0:1788864053.395511:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788864053.395519:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:24949:x1875759226692224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788864053.395617:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:24949:x1875759226692224:12345-0@lo:502:mount.lustre.0 Request processed in 99us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.395633:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788864053.395804:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788864053.396041:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788864053.396068:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788864053.396117:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788864053.396136:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788864053.396150:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788864053.396164:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788864053.396175:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788864053.396259:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788864053.396279:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788864053.396412:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788864053.396431:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788864053.396463:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864053.396503:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864053.396533:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864053.396654:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226692352 00000100:00100000:1.0:1788864053.396660:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226692352 00000100:00100000:1.0:1788864053.396706:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788864053.396713:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:24949:x1875759226692352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788864053.396791:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:24949:x1875759226692352:12345-0@lo:502:mount.lustre.0 Request processed in 77us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.396797:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788864053.396889:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788864053.396996:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788864053.397005:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788864053.398959:0:24958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864053.398976:0:24958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864053.398978:0:24958:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788864053.398985:0:24958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e5429b1000 00000020:00000080:1.0:1788864053.398987:0:24958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788864053.398995:0:24958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864053.398997:0:24958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864053.398998:0:24958:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788864053.399000:0:24958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864053.399002:0:24958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864053.399003:0:24958:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788864053.399006:0:24958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e5429b1000 00000020:00000080:1.0:1788864053.399007:0:24958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788864053.399059:0:24958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864053.399061:0:24958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864053.399062:0:24958:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788864053.399064:0:24958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864053.399066:0:24958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864053.399067:0:24958:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788864053.399070:0:24958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e5429b1000 00000020:00000080:1.0:1788864053.399072:0:24958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788864053.399107:0:24958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864053.399117:0:24958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864053.399118:0:24958:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788864053.399121:0:24958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788864053.399123:0:24958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864053.399124:0:24958:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788864053.399126:0:24958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e5429b1000 00000020:00000080:1.0:1788864053.399128:0:24958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788864053.399146:0:24958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788864053.399148:0:24958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788864053.399149:0:24958:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788864053.399151:0:24958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788864053.402014:0:24949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788864053.402061:0:24949:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788864053.402093:0:24949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab29 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.402108:0:24949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab29 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864053.402181:0:24949:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788864053.402185:0:24949:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e5429b1000 10000000:01000000:3.0:1788864053.402188:0:24949:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e5429b1000 10000000:01000000:3.0:1788864053.402193:0:24949:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788864053.402198:0:24949:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89e5429b1000 from 1 10000000:01000000:3.0:1788864053.402202:0:24949:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788864053.402240:0:24949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167c200/0xf569beb9d4b6ab30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.402248:0:24949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e64167c200/0xf569beb9d4b6ab30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.402259:0:24949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e64167c200/0xf569beb9d4b6ab30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864053.402283:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788864053.402351:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864053.402471:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864053.403005:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226692480 00000100:00100000:0.0:1788864053.403013:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226692480 00000100:00100000:0.0:1788864053.403108:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788864053.403118:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:24949:x1875759226692480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788864053.403133:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864053.403147:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e54357c400/0xf569beb9d4b6ab37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6ab30 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864053.403180:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e54357c400/0xf569beb9d4b6ab37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6ab30 expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864053.403203:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e54357c400/0xf569beb9d4b6ab37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6ab30 expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864053.403212:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e54357c400, rc 0) 00000100:00100000:0.0:1788864053.403259:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:24949:x1875759226692480:12345-0@lo:101:mount.lustre.0 Request processed in 142us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864053.403265:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788864053.406458:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788864053.406488:0:24949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e64167c200/0xf569beb9d4b6ab30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab37 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.406501:0:24949:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e64167c200/0xf569beb9d4b6ab30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6ab37 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788864053.408998:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788864053.409769:0:24949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788864053.410749:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788864053.410793:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788864053.410809:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788864053.410822:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788864053.410834:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788864053.410848:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788864053.410860:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788864053.410874:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788864053.410888:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788864053.410902:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788864053.410995:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788864053.411011:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788864053.411024:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788864053.411037:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788864053.411052:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788864053.411066:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788864053.411131:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788864053.411145:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788864053.411156:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788864053.411168:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788864053.411180:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788864053.411418:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788864053.411434:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788864053.411446:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788864053.411460:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788864053.411473:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788864053.411486:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788864053.411497:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788864053.411510:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788864053.411523:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788864053.411536:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788864053.411547:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788864053.411584:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788864053.411600:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788864053.411625:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788864053.411637:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788864053.411649:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788864053.411661:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788864053.411684:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788864053.411700:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788864053.411713:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788864053.411727:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788864053.411741:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788864053.411755:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788864053.411767:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788864053.411778:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788864053.411791:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788864053.411806:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788864053.413146:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788864053.413390:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788864053.413418:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788864053.413423:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788864053.413529:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788864053.413684:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864053.415440:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6587300c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864053.417451:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226692608 00000100:00100000:1.0:1788864053.417465:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226692608 00000100:00100000:1.0:1788864053.418517:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788864053.418532:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:24949:x1875759226692608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788864053.418741:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:24949:x1875759226692608:12345-0@lo:501:mount.lustre.0 Request processed in 214us (5057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.418750:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788864053.418840:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788864053.421345:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788864053.421439:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864053.421474:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226692736 00000100:00100000:0.0:1788864053.421482:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226692736 00000100:00100000:2.0:1788864053.421486:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e643886300 going to sleep for 11 seconds 00000100:00100000:0.0:1788864053.421578:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788864053.421588:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:24949:x1875759226692736:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788864053.421786:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:24949:x1875759226692736:12345-0@lo:503:mount.lustre.0 Request processed in 199us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864053.421794:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788864053.425209:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788864053.426463:0:24949:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788864053.427000:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864053.427126:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864053.427175:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e643886300 going to sleep for 11 seconds 00000100:00100000:0.0:1788864053.427665:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226692864 00000100:00100000:0.0:1788864053.427685:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226692864 00000100:00100000:0.0:1788864053.427774:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788864053.427785:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:24949:x1875759226692864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788864053.427930:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:24949:x1875759226692864:12345-0@lo:502:mount.lustre.0 Request processed in 146us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864053.427937:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788864053.428036:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788864053.428297:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788864053.428327:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788864053.428340:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788864053.428352:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788864053.428365:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788864053.428377:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788864053.428390:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788864053.428402:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788864053.428415:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788864053.428426:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788864053.428449:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788864053.428463:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788864053.428476:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788864053.428490:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788864053.428502:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788864053.428516:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788864053.428544:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788864053.428572:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788864053.428588:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788864053.428601:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788864053.428614:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788864053.428627:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788864053.428639:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788864053.428652:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788864053.428664:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788864053.428696:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788864053.428708:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788864053.428719:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788864053.428731:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788864053.428743:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788864053.428755:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788864053.428768:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788864053.428794:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788864053.428809:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788864053.428822:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788864053.428834:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788864053.428846:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788864053.428859:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788864053.428872:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788864053.428885:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788864053.428898:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788864053.428910:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788864053.428923:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788864053.428947:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788864053.428960:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788864053.428972:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788864053.428983:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788864053.428996:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788864053.429052:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864053.429125:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864053.430131:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e643886300 going to sleep for 11 seconds 00000100:00100000:1.0:1788864053.430308:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226692992 00000100:00100000:1.0:1788864053.430317:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226692992 00000100:00100000:1.0:1788864053.430357:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788864053.430366:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:24949:x1875759226692992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788864053.430639:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:24949:x1875759226692992:12345-0@lo:502:mount.lustre.0 Request processed in 274us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.430647:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788864053.430748:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226692992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788864053.430943:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788864053.430969:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788864053.430999:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226693120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788864053.431040:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864053.431110:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e643886300 going to sleep for 11 seconds 00000100:00100000:1.0:1788864053.431310:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226693120 00000100:00100000:1.0:1788864053.431315:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226693120 00000100:00100000:1.0:1788864053.431338:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788864053.431343:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:24949:x1875759226693120:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788864053.431425:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:24949:x1875759226693120:12345-0@lo:502:mount.lustre.0 Request processed in 82us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.431432:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788864053.431551:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226693120:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788864053.431600:0:24949:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788864053.431608:0:24949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788864053.444893:0:24963:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788864053.444921:0:24963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89e543a18000) 00000020:00000080:0.0:1788864053.444953:0:24963:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788864053.445041:0:24963:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e5429b1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788864053.445045:0:24963:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e5429b1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788864053.445048:0:24963:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e5429b1000 3 00010000:00080000:0.0:1788864053.445377:0:24963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e659f6e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.135@tcp at head 00010000:00010000:0.0:1788864053.447815:0:24963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788864053.448724:0:24963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788864053.448771:0:24963:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788864053.448786:0:24963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf569beb9d4b6ab45 00000100:00080000:0.0:1788864053.448798:0:24963:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788864053.448810:0:24963:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e659f6e000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788864053.448850:0:24963:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4b8000 x1875759226693248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788864053.448884:0:24963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:0.0:1788864053.449166:0:24963:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:1.0:1788864053.449357:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226693248:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788864053.449429:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864053.449496:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226693248 00000100:00100000:1.0:1788864053.449503:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226693248 00000100:00100000:1.0:1788864053.449539:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864053.449545:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875759226693248:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788864053.449582:0:22630:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 720 last 0 00000020:00000080:1.0:1788864053.449616:0:22630:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf569beb9d4b6ab4c 00000004:00100000:1.0:1788864053.449633:0:22630:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788864053.449667:0:22630:0:(import.c:65:import_set_state_nolock()) ffff89e67e23a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864053.449728:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875759226693248:12345-0@lo:38:llog_process_th.0 Request processed in 182us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.449735:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788864053.449778:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e66d4b8000 x1875759226693248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788864063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864053.449790:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788864053.449797:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788864053.449803:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788864053.449808:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788864053.449810:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e659f6e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788864053.449816:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875759226693248:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1788864053.450303:0:24963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff89e543a1b380) 00000020:00000080:0.0:1788864053.450324:0:24963:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788864053.450400:0:24963:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e5429b1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788864053.450404:0:24963:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e5429b1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788864053.450407:0:24963:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e5429b1000 3 00010000:00080000:0.0:1788864053.450448:0:24963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e544130000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.135@tcp at head 00000100:00080000:3.0:1788864053.454458:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788864053.454464:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788864053.454468:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e67c45b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788864053.454476:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 718 00000100:00080000:3.0:1788864053.454481:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788864053.454493:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e67c45b800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788864053.454514:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544006300 x1875759226693632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788864053.455000:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788864053.455004:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788864053.455006:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e544143000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788864053.455010:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 718 00000100:00080000:3.0:1788864053.455013:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788864053.455018:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e544143000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:3.0:1788864053.455028:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e544004a80 x1875759226694144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788864053.455107:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226693376:0@lo:400:kworker.0 00000100:00100000:3.0:1788864053.456000:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864053.456045:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226694016:0@lo:400:kworker.0 00000100:00100000:3.0:1788864053.456096:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864053.456124:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788864053.456131:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226693888:0@lo:400:kworker.0 00000100:00100000:3.0:1788864053.456154:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864053.456170:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226694528:0@lo:400:kworker.0 00000100:00100000:3.0:1788864053.457388:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864053.457439:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226693504:0@lo:400:kworker.0 00000100:00100000:3.0:1788864053.457481:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864053.457499:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226694272:0@lo:400:kworker.0 00000100:00100000:3.0:1788864053.457520:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864053.457541:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788864053.457547:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226693760:0@lo:400:kworker.0 00010000:00010000:0.0:1788864053.458723:0:24963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788864053.458894:0:24963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000100:00100000:1.0:1788864053.459007:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226693632:0@lo:8:kworker.0 00000100:00100000:1.0:1788864053.459068:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864053.459115:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226694144:0@lo:8:kworker.0 00000100:00100000:1.0:1788864053.459138:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864053.459182:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226694016 00000100:00100000:3.0:1788864053.459406:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864053.459428:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226694400:0@lo:400:kworker.0 00000100:00100000:3.0:1788864053.459448:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864053.459470:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226693376 00000100:00100000:3.0:1788864053.459478:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226693376 00000100:00100000:3.0:1788864053.459515:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226693888 00000100:00100000:3.0:1788864053.459519:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226693888 00000100:00100000:3.0:1788864053.459536:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788864053.459544:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226693376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864053.460030:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226693376:12345-0@lo:400:kworker.0 Request processed in 485us (4030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864053.460038:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788864053.460056:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788864053.460063:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226693888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864053.460112:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226693888:12345-0@lo:400:kworker.0 Request processed in 50us (3957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864053.460118:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788864053.460160:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226693888:0@lo:400:kworker.0 00000100:00100000:3.0:1788864053.460172:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226693376:0@lo:400:kworker.0 00000100:00100000:1.0:1788864053.460264:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226694016 00000010:01000000:0.0:1788864053.460418:0:24963:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788864053.460430:0:24963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf569beb9d4b6ab5a 00000100:00080000:0.0:1788864053.460438:0:24963:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788864053.460446:0:24963:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff89e544130000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:0.0:1788864053.460480:0:24963:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e66d4ba300 x1875759226694656/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788864053.460514:0:24963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788864053.460644:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226693504 00000100:00100000:1.0:1788864053.460649:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226693504 00000100:00100000:1.0:1788864053.460664:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226693632 00000100:00100000:1.0:1788864053.460677:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226693632 00000100:00100000:1.0:1788864053.460688:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226694144 00000100:00100000:1.0:1788864053.460690:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226694144 00000100:00100000:1.0:1788864053.460700:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788864053.460707:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226694016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864053.460745:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226694016:12345-0@lo:400:kworker.0 Request processed in 38us (4648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.460751:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788864053.460765:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864053.460771:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226693504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864053.460811:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226694016:0@lo:400:kworker.0 00000100:00100000:3.0:1788864053.461052:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788864053.461058:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875759226693632:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788864053.461120:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875759226693632:12345-0@lo:8:kworker.0 Request processed in 61us (2052us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788864053.461126:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788864053.461148:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788864053.461152:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875759226694144:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788864053.461435:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226693504:12345-0@lo:400:kworker.0 Request processed in 664us (3952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.461442:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788864053.461464:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226694528 00000100:00100000:1.0:1788864053.461468:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226694528 00000100:00100000:1.0:1788864053.461493:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226694272 00000100:00100000:1.0:1788864053.461496:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226694272 00000100:00100000:1.0:1788864053.461506:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226693760 00000100:00100000:1.0:1788864053.461509:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226693760 00000100:00100000:1.0:1788864053.461518:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226694400 00000100:00100000:1.0:1788864053.461520:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226694400 00000100:00100000:1.0:1788864053.461547:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788864053.461552:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226694528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864053.461602:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875759226694528:12345-0@lo:400:kworker.0 Request processed in 50us (4218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.461608:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788864053.461619:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788864053.461625:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226694272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864053.461652:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875759226694272:12345-0@lo:400:kworker.0 Request processed in 27us (4131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.461658:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788864053.461679:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788864053.461685:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226693760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864053.461712:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226693760:12345-0@lo:400:kworker.0 Request processed in 28us (2305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.461718:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788864053.461730:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788864053.461736:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226694400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864053.461761:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226694400:12345-0@lo:400:kworker.0 Request processed in 26us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.461767:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788864053.461791:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788864053.461795:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788864053.461797:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788864053.461822:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e544004000 x1875759226693760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864053.461835:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226693760:0@lo:400:kworker.0 00010000:00080000:1.0:1788864053.461856:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e544005f80 x1875759226694400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864053.461865:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226694400:0@lo:400:kworker.0 00000100:00100000:1.0:1788864053.461876:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226693504:0@lo:400:kworker.0 00010000:00080000:1.0:1788864053.461886:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e544007100 x1875759226694272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864053.461893:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875759226694272:0@lo:400:kworker.0 00010000:00080000:1.0:1788864053.461939:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e544006680 x1875759226694528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864053.461948:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875759226694528:0@lo:400:kworker.0 00000100:00100000:1.0:1788864053.461968:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875759226694656:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788864053.462004:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864053.462043:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788864053.462050:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67c45b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864053.462054:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788864053.462058:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226693632:0@lo:8:kworker.0 00000100:00100000:1.0:1788864053.462067:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788864053.462070:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544143000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788864053.462073:0:3639:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788864053.462094:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226694144:0@lo:8:kworker.0 00000100:00100000:1.0:1788864053.462115:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226694656 00000100:00100000:1.0:1788864053.462119:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226694656 00000100:00100000:1.0:1788864053.462141:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788864053.462145:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875759226694656:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788864053.462163:0:22629:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 720 last 0 00000040:00080000:0.0:1788864053.464416:0:24963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:3.0:1788864053.464664:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875759226694144:12345-0@lo:8:kworker.0 Request processed in 33us (2049us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788864053.464688:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000020:01000000:3.0:1788864053.464751:0:24949:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788864053.464787:0:24949:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788864053.464811:0:24949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e64167c200/0xf569beb9d4b6ab30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab37 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.464822:0:24949:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e64167c200/0xf569beb9d4b6ab30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab37 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788864053.464867:0:24949:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788864053.464870:0:24949:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788864053.464871:0:24949:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864053.464872:0:24949:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864053.464874:0:24949:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864053.464875:0:24949:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864053.464877:0:24949:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788864053.464879:0:24949:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864053.464880:0:24949:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788864053.464884:0:24949:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788864053.464887:0:24949:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788864053.464888:0:24949:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788864053.464889:0:24949:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788864053.464890:0:24949:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788864053.464891:0:24949:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788864053.464892:0:24949:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788864053.464893:0:24949:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788864053.464894:0:24949:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788864053.464895:0:24949:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000080:1.0:1788864053.465036:0:22629:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf569beb9d4b6ab61 00000004:00100000:1.0:1788864053.465055:0:22629:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788864053.465112:0:22629:0:(import.c:65:import_set_state_nolock()) ffff89e67e23e000 : changing import state from RECOVER to FULL 10000000:01000000:3.0:1788864053.465395:0:24949:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788864053.465413:0:24949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226694784:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788864053.465465:0:24949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864053.465523:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875759226694656:12345-0@lo:38:llog_process_th.0 Request processed in 3376us (3518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.465532:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788864053.465590:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e66d4ba300 x1875759226694656/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788864063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864053.465601:0:3639:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788864053.465608:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788864053.465616:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788864053.465621:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788864053.465623:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544130000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788864053.465629:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875759226694656:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788864053.465755:0:24949:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6587300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864053.467830:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226694784 00000100:00100000:0.0:1788864053.467846:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226694784 00000100:00100000:0.0:1788864053.468057:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788864053.468068:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:24949:x1875759226694784:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788864053.468436:0:22621:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788864053.468452:0:22621:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788864053.474293:0:22621:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788864053.474314:0:22621:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788864053.474367:0:22644:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788864053.474372:0:22644:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788864053.474401:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.474419:0:22644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e54357dc00/0xf569beb9d4b6a9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a9f5 expref: 24 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.474428:0:22644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e64167cc00/0xf569beb9d4b6aa0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6aa03 expref: 24 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.474436:0:22644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.474476:0:22644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e64167cc00/0xf569beb9d4b6aa0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6aa03 expref: 24 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.474491:0:22644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e64167cc00/0xf569beb9d4b6aa0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6aa03 expref: 24 pid: 22623 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864053.474504:0:22644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226694912:0@lo:104: 00000100:00100000:3.0:1788864053.474575:0:22644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788864053.474632:0:22644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e54357dc00/0xf569beb9d4b6a9fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a9f5 expref: 24 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.474640:0:22644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e54357dc00/0xf569beb9d4b6a9fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a9f5 expref: 24 pid: 22623 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864053.474648:0:22644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226695040:0@lo:104: 00000100:00100000:3.0:1788864053.474694:0:22644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864053.474719:0:22644:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e65d5d7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788864053.474891:0:22612:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226694912 00000100:00100000:2.0:1788864053.474901:0:22612:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226694912 00000100:00100000:2.0:1788864053.474948:0:22612:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226695040 00000100:00100000:2.0:1788864053.474952:0:22612:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226695040 00000100:00100000:2.0:1788864053.474967:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788864053.474976:0:22612:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+4:22644:x1875759226694912:12345-0@lo:104: 00010000:00010000:2.0:1788864053.474988:0:22612:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6aa0a expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864053.475047:0:22612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788864053.475053:0:22612:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+4:22644:x1875759226694912:12345-0@lo:104: Request processed in 78us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864053.475065:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788864053.475108:0:22612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788864053.475114:0:22612:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:22644:x1875759226695040:12345-0@lo:104: 00010000:00010000:2.0:1788864053.475122:0:22612:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a9fc expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864053.475154:0:22612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788864053.475158:0:22612:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:22644:x1875759226695040:12345-0@lo:104: Request processed in 45us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864053.475164:0:22612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788864053.475465:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:24949:x1875759226694784:12345-0@lo:253:mount.lustre.0 Request processed in 7399us (9999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864053.475475:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788864053.475704:0:22644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226694912:0@lo:104: 00000100:00100000:3.0:1788864053.475714:0:22644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22644:1875759226695040:0@lo:104: 00010000:00010000:3.0:1788864053.475735:0:22644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.475751:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788864053.475757:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6aa0a expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.475764:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e54357d200 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788864053.475768:0:23384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6aa0a expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.475778:0:23384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6aa0a expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788864053.475784:0:23384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6aa0a expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864053.475790:0:23384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788864053.475827:0:23384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6aa0a expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.475833:0:23384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788864053.475854:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6aa0a expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.475860:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e54357d200/0xf569beb9d4b6aa03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6aa0a expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.475879:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864053.475883:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a9fc expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.475888:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e640030800 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:3.0:1788864053.475891:0:23384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a9fc expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.475898:0:23384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a9fc expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788864053.475915:0:23384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a9fc expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864053.475920:0:23384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788864053.475934:0:23384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a9fc expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.475940:0:23384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788864053.475952:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a9fc expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.475959:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e640030800/0xf569beb9d4b6a9f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a9fc expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864053.475972:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864053.475974:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864053.475976:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864053.475982:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864053.475994:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788864053.476007:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226695168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788864053.476040:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864053.476221:0:24949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:24949:1875759226694784:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788864053.476233:0:24949:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788864053.476236:0:24949:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788864053.476238:0:24949:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788864053.476240:0:24949:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788864053.476241:0:24949:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788864053.476242:0:24949:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788864053.476243:0:24949:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788864053.476250:0:24949:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788864053.476252:0:24949:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788864053.476253:0:24949:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788864053.476267:0:24949:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788864053.479722:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226695168 00000100:00100000:0.0:1788864053.479736:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226695168 00010000:00010000:0.0:1788864053.479780:0:22615:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e64167cc00/0xf569beb9d4b6aa0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6aa03 expref: 24 pid: 22623 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864053.479831:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788864053.479841:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:3642:x1875759226695168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788864053.479857:0:22615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864053.479863:0:22615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e64167cc00/0xf569beb9d4b6aa0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6aa03 expref: 24 pid: 22623 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864053.479875:0:22615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e64167cc00/0xf569beb9d4b6aa0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6aa03 expref: 24 pid: 22623 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864053.479894:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167cc00/0xf569beb9d4b6aa0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6aa03 expref: 24 pid: 22623 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864053.479924:0:22615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864053.479999:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:3642:x1875759226695168:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (3957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864053.480021:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788864053.480505:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788864053.480532:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226695296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788864053.480584:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864053.480631:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226695296 00000100:00100000:1.0:1788864053.480635:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226695296 00010000:00010000:1.0:1788864053.480651:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e54357dc00/0xf569beb9d4b6a9fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a9f5 expref: 23 pid: 22623 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864053.480680:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788864053.480687:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:3641:x1875759226695296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788864053.480695:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864053.480700:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e54357dc00/0xf569beb9d4b6a9fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a9f5 expref: 23 pid: 22623 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.480708:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e54357dc00/0xf569beb9d4b6a9fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a9f5 expref: 23 pid: 22623 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.480719:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e54357dc00/0xf569beb9d4b6a9fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a9f5 expref: 23 pid: 22623 timeout: 820 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.480731:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.480739:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788864053.480754:0:22613:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006382337s 00010000:00010000:1.0:1788864053.480759:0:22613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.480772:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.480779:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.480786:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.480793:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167d200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864053.480797:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.480806:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.480821:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.480831:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788864053.480861:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:3641:x1875759226695296:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.480868:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788864053.480894:0:22644:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.480913:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864053.480920:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e64167d200/0xf569beb9d4b6ab68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864053.480965:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226695296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788864053.482448:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226695168:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788864053.484031:0:24949:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788864053.490797:0:24949:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788864053.490810:0:24949:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788864053.490849:0:24949:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788864053.490899:0:24949:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.135@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788864053.490928:0:24949:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788864053.490959:0:24949:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788864053.492137:0:24949:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788864053.496487:0:24949:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788864053.680052:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788864053.740021:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226695424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788864053.740398:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864053.740511:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226695424 00000100:00100000:0.0:1788864053.740519:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226695424 00000100:00100000:0.0:1788864053.740577:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788864053.740588:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226695424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788864053.740633:0:23371:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788864053.740731:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226695424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864053.740738:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788864053.740823:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226695424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788864053.742852:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226695552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788864053.742923:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864053.743004:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226695552 00000100:00100000:1.0:1788864053.743011:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226695552 00000100:00100000:1.0:1788864053.743101:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788864053.743112:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226695552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788864053.743147:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788864053.743997:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226695552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 882us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864053.744007:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788864053.744260:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226695552:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788864053.933703:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788864054.536138:0:25016:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788864054.536388:0:25016:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788864054.767042:0:22625:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788864054.767051:0:22625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e54399a800 from 14 10000000:01000000:2.0:1788864054.767056:0:22625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788864054.767130:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e6808bc400/0xf569beb9d4b6ab6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.767143:0:22625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e6808bc400/0xf569beb9d4b6ab6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.767155:0:22625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e6808bc400/0xf569beb9d4b6ab6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864054.767181:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226695680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788864054.767246:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864054.767292:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6599459c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864054.767348:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226695680 00000100:00100000:2.0:1788864054.767356:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226695680 00000100:00100000:2.0:1788864054.767414:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788864054.767422:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:22625:x1875759226695680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864054.767438:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864054.767452:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e6808bd000/0xf569beb9d4b6ab76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6ab6f expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.767476:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e6808bd000/0xf569beb9d4b6ab76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6ab6f expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.767486:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e6808bd000/0xf569beb9d4b6ab76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6ab6f expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.767495:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bd000, rc 0) 00000100:00100000:2.0:1788864054.769657:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:22625:x1875759226695680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864054.769669:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788864054.769748:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226695680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864054.769770:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e6808bc400/0xf569beb9d4b6ab6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab76 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.769781:0:22625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e6808bc400/0xf569beb9d4b6ab6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6ab76 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864054.770513:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226695808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788864054.770659:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864054.770701:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788864054.770726:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226695808 00000100:00100000:2.0:1788864054.770732:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226695808 00000100:00100000:2.0:1788864054.770773:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788864054.770780:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:22625:x1875759226695808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788864054.770799:0:22621:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788864054.770815:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788864054.770817:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788864054.770889:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:22625:x1875759226695808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864054.770896:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788864054.770928:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226695808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788864054.770981:0:22625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788864054.770989:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e6808bc400/0xf569beb9d4b6ab6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab76 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.770998:0:22625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e6808bc400/0xf569beb9d4b6ab6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab76 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864054.771007:0:22625:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788864054.771009:0:22625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff89e680890800 from 14 10000000:01000000:2.0:1788864054.771012:0:22625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788864054.771035:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e6808bda00/0xf569beb9d4b6ab7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.771042:0:22625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e6808bda00/0xf569beb9d4b6ab7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.771050:0:22625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e6808bda00/0xf569beb9d4b6ab7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864054.771091:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226695936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788864054.771706:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864054.771732:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788864054.771747:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226695936 00000100:00100000:2.0:1788864054.771751:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226695936 00000100:00100000:2.0:1788864054.771773:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788864054.771778:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:22625:x1875759226695936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864054.771788:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864054.771800:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e6808bca00/0xf569beb9d4b6ab84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6ab7d expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.771818:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e6808bca00/0xf569beb9d4b6ab84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6ab7d expref: 24 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.771827:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e6808bca00/0xf569beb9d4b6ab84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6ab7d expref: 24 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.771835:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e6808bca00, rc 0) 00000100:00100000:2.0:1788864054.771859:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:22625:x1875759226695936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864054.771864:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788864054.771893:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226695936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864054.771905:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e6808bda00/0xf569beb9d4b6ab7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab84 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.771914:0:22625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e6808bda00/0xf569beb9d4b6ab7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6ab84 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864054.771955:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226696064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788864054.771980:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864054.771991:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542906a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788864054.772001:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226696064 00000100:00100000:2.0:1788864054.772004:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226696064 00000100:00100000:2.0:1788864054.772021:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788864054.772026:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:22625:x1875759226696064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788864054.772036:0:22622:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788864054.772046:0:22622:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788864054.772048:0:22622:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788864054.772162:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:22625:x1875759226696064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864054.772169:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788864054.772198:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226696064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788864054.772236:0:22625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788864054.772241:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e6808bda00/0xf569beb9d4b6ab7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab84 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864054.772249:0:22625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e6808bda00/0xf569beb9d4b6ab7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ab84 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864054.955266:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864055.983221:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864056.811318:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864056.811341:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226696192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788864056.811442:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864056.811853:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226696192 00000100:00100000:1.0:1788864056.811864:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226696192 00000100:00100000:1.0:1788864056.811932:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864056.811942:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226696192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788864056.811971:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788864056.812036:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226696192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864056.812042:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788864056.812109:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788864056.812239:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226696192:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788864057.006538:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864057.836020:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226696320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788864057.836128:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864057.836244:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226696320 00000100:00100000:1.0:1788864057.836254:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226696320 00000100:00080000:3.0:1788864057.836319:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864057.836332:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788864057.836342:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226696320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788864057.836364:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788864057.836419:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226696320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864057.836427:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788864057.836469:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226696320:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788864058.027315:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864058.860315:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226696448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788864058.860460:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.860542:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226696448 00000100:00100000:1.0:1788864058.860550:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226696448 00000100:00100000:1.0:1788864058.860617:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788864058.860626:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226696448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788864058.860658:0:22634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788864058.860723:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226696448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.860927:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788864058.860985:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226696448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788864058.864212:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226696576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788864058.864277:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.864345:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226696576 00000100:00100000:1.0:1788864058.864352:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226696576 00000100:00100000:1.0:1788864058.864394:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788864058.864402:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226696576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788864058.864521:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788864058.864579:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226696576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 177us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.864596:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788864058.864722:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226696576:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788864058.871390:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864058.871396:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788864058.871400:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e67c45b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788864058.871416:0:13187:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e67c45b800 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788864058.871438:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e54420ad80 x1875759226696960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788864058.871485:0:13187:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788864058.871488:0:13187:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788864058.871617:0:13187:0:(import.c:65:import_set_state_nolock()) ffff89e544143000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788864058.871627:0:13187:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff89e544143000 using connection 192.168.204.135@tcp/0@lo 00000100:00100000:1.0:1788864058.871641:0:13187:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e54420b480 x1875759226697344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788864058.871710:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226696960:0@lo:8:kworker.0 00000100:00100000:1.0:1788864058.871778:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.871811:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226697344:0@lo:8:kworker.0 00000100:00100000:1.0:1788864058.871830:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.871876:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226696960 00000100:00100000:1.0:1788864058.871885:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226696960 00000100:00100000:1.0:1788864058.871918:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226697344 00000100:00100000:1.0:1788864058.871920:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226697344 00000100:00100000:1.0:1788864058.871937:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788864058.871944:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875759226696960:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788864058.871988:0:24138:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:1.0:1788864058.872021:0:24138:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf569beb9d4b6ab8b 00002000:00100000:1.0:1788864058.872035:0:24138:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89e6459ed000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788864058.872038:0:24138:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788864058.872041:0:24138:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788864058.872434:0:24138:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788864058.872461:0:24138:0:(import.c:65:import_set_state_nolock()) ffff89e6459e8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788864058.872481:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788864058.872489:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875759226697344:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788864058.872508:0:24136:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:3.0:1788864058.872525:0:24136:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf569beb9d4b6ab92 00002000:00100000:3.0:1788864058.872531:0:24136:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff89e5428ca800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788864058.872534:0:24136:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788864058.872536:0:24136:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788864058.872575:0:24136:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788864058.872589:0:24136:0:(import.c:65:import_set_state_nolock()) ffff89e5428c9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864058.872622:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1875759226696960:12345-0@lo:8:kworker.0 Request processed in 675us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864058.872628:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875759226697344:12345-0@lo:8:kworker.0 Request processed in 138us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.872634:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788864058.872649:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788864058.872677:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3643:1875759226696704:0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.872714:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.872751:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226697472:0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.872777:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.872795:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226697984:0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.872813:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.872836:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788864058.872841:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226697216:0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.872860:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.872875:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226697856:0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.872893:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.872918:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226696704 00000100:00100000:1.0:1788864058.872924:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226696704 00000100:00100000:1.0:1788864058.872954:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788864058.872960:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:3643:x1875759226696704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.873000:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:3643:x1875759226696704:12345-0@lo:400:kworker.0 Request processed in 41us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.873007:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788864058.873035:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226697472 00000100:00100000:1.0:1788864058.873039:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226697472 00000100:00100000:1.0:1788864058.873059:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226697984 00000100:00100000:1.0:1788864058.873062:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226697984 00000100:00100000:1.0:1788864058.873105:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226697856 00000100:00100000:1.0:1788864058.873109:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226697856 00000100:00100000:1.0:1788864058.873280:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788864058.873289:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226697472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.873321:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226697472:12345-0@lo:400:kworker.0 Request processed in 35us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.873327:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788864058.873339:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788864058.873345:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226697984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.873369:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226697984:12345-0@lo:400:kworker.0 Request processed in 25us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.873376:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788864058.873386:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788864058.873391:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226697856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.873435:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875759226697856:12345-0@lo:400:kworker.0 Request processed in 44us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.873441:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788864058.873467:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788864058.873614:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788864058.873630:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226696832:0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.873664:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.873690:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226697600:0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.873712:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.873732:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788864058.873738:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226697088:0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.873757:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.873771:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226697728:0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.873788:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.873808:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226697600 00000100:00100000:1.0:1788864058.873813:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226697600 00000100:00100000:1.0:1788864058.873835:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226697088 00000100:00100000:1.0:1788864058.873838:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226697088 00000100:00100000:1.0:1788864058.873847:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226697728 00000100:00100000:1.0:1788864058.873848:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226697728 00000100:00100000:1.0:1788864058.873861:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788864058.873866:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226697600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.873898:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875759226697600:12345-0@lo:400:kworker.0 Request processed in 31us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.873903:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788864058.873915:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788864058.873920:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226697088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.873945:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226697088:12345-0@lo:400:kworker.0 Request processed in 24us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.873950:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788864058.873961:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788864058.873966:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226697728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.874001:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226697728:12345-0@lo:400:kworker.0 Request processed in 35us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.874008:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788864058.874024:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788864058.874027:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788864058.874362:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54420ad80 x1875759226696960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788864083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788864058.874380:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788864058.874387:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788864058.874391:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788864058.874394:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e67c45b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788864058.874409:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788864058.874415:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875759226696960:0@lo:8:kworker.0 00010000:00080000:1.0:1788864058.874428:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54420b480 x1875759226697344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788864083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788864058.874438:0:3639:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788864058.874442:0:3639:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788864058.874445:0:3639:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788864058.874446:0:3639:0:(import.c:65:import_set_state_nolock()) ffff89e544143000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788864058.874465:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000004:00080000:3.0:1788864058.874687:0:22654:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788864058.874758:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875759226697344:0@lo:8:kworker.0 00000004:00080000:1.0:1788864058.874816:0:22655:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788864058.874834:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22655:1875759226698240:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788864058.874865:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.874885:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542802e40 going to sleep for 11 seconds 00000004:00080000:1.0:1788864058.874915:0:23375:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788864058.874929:0:23375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54420b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23375:1875759226698496:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788864058.874951:0:23375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.874966:0:23375:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e542802cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864058.874980:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226697216 00000100:00100000:1.0:1788864058.874984:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226697216 00000100:00100000:1.0:1788864058.875014:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226696832 00000100:00100000:1.0:1788864058.875018:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226696832 00000100:00100000:1.0:1788864058.875039:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226698240 00000100:00100000:1.0:1788864058.875042:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226698240 00000100:00100000:1.0:1788864058.875058:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226698496 00000100:00100000:1.0:1788864058.875061:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226698496 00000004:00080000:3.0:1788864058.875066:0:22654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725998988910ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788864058.875096:0:22654:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788864058.875101:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788864058.875110:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226697216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.875215:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226697216:12345-0@lo:400:kworker.0 Request processed in 105us (2352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.875222:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788864058.875237:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864058.875243:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226696832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.875272:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226696832:12345-0@lo:400:kworker.0 Request processed in 29us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.875277:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788864058.875289:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788864058.875294:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22655:x1875759226698240:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788864058.875548:0:23374:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788864058.875613:0:23374:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 725999535584ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788864058.875618:0:23374:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788864058.875815:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788864058.875824:0:24435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23375:x1875759226698496:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:1.0:1788864058.875857:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788864058.875866:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864058.875880:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226698112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788864058.875914:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788864058.875950:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544208a80 x1875759226697088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864058.875961:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226697088:0@lo:400:kworker.0 00010000:00080000:1.0:1788864058.875971:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0d500 x1875759226697728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864058.875979:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226697728:0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.875989:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226696832:0@lo:400:kworker.0 00010000:00080000:1.0:1788864058.875999:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0d880 x1875759226697600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864058.876005:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875759226697600:0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.876068:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788864058.876406:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226698368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788864058.876437:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864058.876476:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226698112 00000100:00100000:1.0:1788864058.876481:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226698112 00000100:00100000:1.0:1788864058.876580:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226698368 00000100:00100000:1.0:1788864058.876584:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226698368 00000100:00100000:1.0:1788864058.876598:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788864058.876606:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875759226698112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788864058.876627:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788864058.876735:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875759226698112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.876752:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788864058.876769:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788864058.876774:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1875759226698368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788864058.876783:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788864058.876807:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1875759226698368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864058.876812:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788864058.876867:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226697216:0@lo:400:kworker.0 00010000:00080000:1.0:1788864058.876881:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0ca80 x1875759226697856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864058.876891:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875759226697856:0@lo:400:kworker.0 00000100:00100000:1.0:1788864058.876900:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3643:1875759226696704:0@lo:400:kworker.0 00010000:00080000:1.0:1788864058.876912:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e54420bb80 x1875759226697472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864058.876920:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226697472:0@lo:400:kworker.0 00010000:00080000:1.0:1788864058.876930:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0ed80 x1875759226697984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864058.876937:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226697984:0@lo:400:kworker.0 00010000:00080000:1.0:1788864058.877071:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0ea00 x1875759226698368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864058.877103:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226698368:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788864058.877196:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0d180 x1875759226698112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788864074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864058.877208:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226698112:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1788864058.878587:0:24136:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788864058.878596:0:24136:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1788864058.878601:0:24136:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00000004:00080000:3.0:1788864058.883722:0:22608:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788864058.884254:0:23362:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:1.0:1788864058.895370:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864058.895384:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ab99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.895403:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1788864058.895408:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864058.895414:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ab99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.895436:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ab99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.895446:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ab99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.895453:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ab99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.895476:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788864058.895551:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864058.895573:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ab99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.895581:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864058.895585:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ab99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.895638:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ab99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.895714:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ab99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.895721:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ab99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.895738:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.895740:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.895743:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788864058.896168:0:24435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788864058.896174:0:24435:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00002000:00010000:1.0:1788864058.896268:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864058.896275:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7c796f/0xf569beb9d4b6aba0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.896284:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1788864058.896288:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864058.896293:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c7c796f/0xf569beb9d4b6aba0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.896316:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c7c796f/0xf569beb9d4b6aba0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.896324:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7c796f/0xf569beb9d4b6aba0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.896331:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c7c796f/0xf569beb9d4b6aba0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.896355:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788864058.896417:0:24435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23375:x1875759226698496:12345-0@lo:7:osp-pre-1-1.0 Request processed in 20589us (21459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864058.896429:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00002000:00010000:1.0:1788864058.897298:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864058.897308:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aba7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.897319:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1788864058.897322:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864058.897327:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aba7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.897339:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aba7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.897349:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aba7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.897366:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aba7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.897392:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788864058.897749:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788864058.897757:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c7c796f/0xf569beb9d4b6aba0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.897765:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fa00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864058.897770:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7c796f/0xf569beb9d4b6aba0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.897779:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7c796f/0xf569beb9d4b6aba0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.897797:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c7c796f/0xf569beb9d4b6aba0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.897804:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c7c796f/0xf569beb9d4b6aba0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.897825:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864058.897828:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aba7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.897834:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864058.897843:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aba7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.897850:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aba7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.897861:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aba7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.897868:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002cb89d9/0xf569beb9d4b6aba7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.897880:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864058.897882:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864058.897883:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788864058.898888:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788864058.898901:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6abae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.898915:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1788864058.898919:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864058.898924:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6abae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.898936:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6abae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.898945:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6abae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.898961:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6abae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.898985:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788864058.899240:0:23375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54420b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23375:1875759226698496:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788864058.899257:0:23375:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00010000:00010000:1.0:1788864058.899290:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864058.899298:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6abae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.899306:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167d200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864058.899310:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6abae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.899320:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6abae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.899334:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6abae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.899340:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6abae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.899359:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.899360:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.899362:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.899597:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864058.902793:0:23375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23375:1875759226698624:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788864058.902885:0:23375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864058.902926:0:23375:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64ae22300 going to sleep for 11 seconds 00000100:00100000:0.0:1788864058.903745:0:24137:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226698624 00000100:00100000:0.0:1788864058.903757:0:24137:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226698624 00000100:00100000:0.0:1788864058.903811:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788864058.903820:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23375:x1875759226698624:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788864058.903852:0:24137:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788864058.903901:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23375:x1875759226698624:12345-0@lo:5:osp-pre-1-1.0 Request processed in 83us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864058.903908:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00002000:00010000:2.0:1788864058.904751:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788864058.904763:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038b6deef/0xf569beb9d4b6abb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.904780:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1788864058.904785:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864058.904791:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038b6deef/0xf569beb9d4b6abb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.904809:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038b6deef/0xf569beb9d4b6abb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.904820:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038b6deef/0xf569beb9d4b6abb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.904831:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038b6deef/0xf569beb9d4b6abb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.904857:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788864058.905030:0:23375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23375:1875759226698624:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788864058.905046:0:23375:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788864058.905111:0:23375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23375:1875759226698752:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788864058.905158:0:23375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864058.905179:0:23375:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e64ae22300 going to sleep for 11 seconds 00000100:00100000:0.0:1788864058.905211:0:24435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226698752 00000100:00100000:0.0:1788864058.905217:0:24435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226698752 00000100:00100000:0.0:1788864058.905250:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788864058.905256:0:24435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23375:x1875759226698752:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788864058.905285:0:24435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:2.0:1788864058.906595:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864058.906842:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864058.906857:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038b6deef/0xf569beb9d4b6abb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.906870:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bd200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864058.906875:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038b6deef/0xf569beb9d4b6abb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.906885:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038b6deef/0xf569beb9d4b6abb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.906907:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038b6deef/0xf569beb9d4b6abb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.906914:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038b6deef/0xf569beb9d4b6abb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.906934:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.906936:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.906937:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.907337:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1f0940/0xf569beb9d4b6abbc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.907358:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1788864058.907363:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864058.907370:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d1f0940/0xf569beb9d4b6abbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.907383:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d1f0940/0xf569beb9d4b6abbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.907403:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1f0940/0xf569beb9d4b6abbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.907418:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d1f0940/0xf569beb9d4b6abbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.907438:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788864058.909162:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864058.909174:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d1f0940/0xf569beb9d4b6abbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.909189:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bde00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864058.909196:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1f0940/0xf569beb9d4b6abbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.909219:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1f0940/0xf569beb9d4b6abbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.909238:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d1f0940/0xf569beb9d4b6abbc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.909246:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d1f0940/0xf569beb9d4b6abbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.909268:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.909269:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.909271:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788864058.909662:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788864058.909671:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9da900/0xf569beb9d4b6abc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.909684:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1788864058.909689:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864058.909696:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a9da900/0xf569beb9d4b6abc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.909708:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a9da900/0xf569beb9d4b6abc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.909729:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a9da900/0xf569beb9d4b6abc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.909737:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a9da900/0xf569beb9d4b6abc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.909763:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788864058.911413:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864058.911427:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a9da900/0xf569beb9d4b6abc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.911440:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bd800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864058.911445:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9da900/0xf569beb9d4b6abc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.911457:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a9da900/0xf569beb9d4b6abc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.911486:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a9da900/0xf569beb9d4b6abc3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.911515:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a9da900/0xf569beb9d4b6abc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.911546:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.911548:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.911550:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788864058.912369:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788864058.912380:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b80992c6/0xf569beb9d4b6abca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.912412:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1788864058.912417:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864058.912424:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b80992c6/0xf569beb9d4b6abca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.912438:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b80992c6/0xf569beb9d4b6abca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.912447:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b80992c6/0xf569beb9d4b6abca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.912463:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b80992c6/0xf569beb9d4b6abca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.912490:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788864058.913109:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788864058.913117:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8c4b2a4/0xf569beb9d4b6abd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.913126:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1788864058.913129:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864058.913133:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8c4b2a4/0xf569beb9d4b6abd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.913144:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8c4b2a4/0xf569beb9d4b6abd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.913153:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8c4b2a4/0xf569beb9d4b6abd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.913160:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8c4b2a4/0xf569beb9d4b6abd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.913180:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788864058.913635:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788864058.913643:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b80992c6/0xf569beb9d4b6abca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.913651:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bc200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864058.913656:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b80992c6/0xf569beb9d4b6abca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.913673:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b80992c6/0xf569beb9d4b6abca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.913693:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b80992c6/0xf569beb9d4b6abca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.913700:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b80992c6/0xf569beb9d4b6abca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.913725:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864058.913728:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8c4b2a4/0xf569beb9d4b6abd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.913735:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bc800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864058.913738:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8c4b2a4/0xf569beb9d4b6abd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.913745:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8c4b2a4/0xf569beb9d4b6abd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.913754:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8c4b2a4/0xf569beb9d4b6abd1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.913761:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8c4b2a4/0xf569beb9d4b6abd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.913787:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.913789:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.913791:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.916033:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788864058.916100:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788864058.916110:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005bcf939/0xf569beb9d4b6abd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.916126:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1788864058.916137:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864058.916144:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005bcf939/0xf569beb9d4b6abd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.916159:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005bcf939/0xf569beb9d4b6abd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.916169:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005bcf939/0xf569beb9d4b6abd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.916176:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005bcf939/0xf569beb9d4b6abd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.918144:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788864058.923405:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788864058.923420:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9231be5/0xf569beb9d4b6abdf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.923437:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1788864058.923442:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864058.923448:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9231be5/0xf569beb9d4b6abdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.923463:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9231be5/0xf569beb9d4b6abdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.923473:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9231be5/0xf569beb9d4b6abdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.923480:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9231be5/0xf569beb9d4b6abdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.923939:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788864058.923949:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005bcf939/0xf569beb9d4b6abd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.923960:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f1c00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864058.923965:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005bcf939/0xf569beb9d4b6abd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.923975:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005bcf939/0xf569beb9d4b6abd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.923994:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005bcf939/0xf569beb9d4b6abd8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.924001:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005bcf939/0xf569beb9d4b6abd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.924022:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864058.924026:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9231be5/0xf569beb9d4b6abdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.924040:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e54357dc00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864058.924043:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9231be5/0xf569beb9d4b6abdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.924051:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9231be5/0xf569beb9d4b6abdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.924063:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9231be5/0xf569beb9d4b6abdf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.924071:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.924097:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.924100:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.924542:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788864058.924549:0:24136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9231be5/0xf569beb9d4b6abdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.924659:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788864058.925346:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788864058.925355:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002412ec7/0xf569beb9d4b6abe6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.925368:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1788864058.925372:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864058.925378:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002412ec7/0xf569beb9d4b6abe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.925391:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002412ec7/0xf569beb9d4b6abe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.925401:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002412ec7/0xf569beb9d4b6abe6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.925416:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002412ec7/0xf569beb9d4b6abe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.925439:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864058.925600:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864058.925611:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002412ec7/0xf569beb9d4b6abe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.925619:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f0400 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864058.925624:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002412ec7/0xf569beb9d4b6abe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.925632:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002412ec7/0xf569beb9d4b6abe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.925645:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002412ec7/0xf569beb9d4b6abe6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.925653:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002412ec7/0xf569beb9d4b6abe6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.925668:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.925670:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.925672:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788864058.926137:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788864058.926143:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000119c7244/0xf569beb9d4b6abed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.926152:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1788864058.926155:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864058.926159:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000119c7244/0xf569beb9d4b6abed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.926169:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000119c7244/0xf569beb9d4b6abed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.926177:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000119c7244/0xf569beb9d4b6abed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.926184:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000119c7244/0xf569beb9d4b6abed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.926214:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864058.926367:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864058.926374:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000119c7244/0xf569beb9d4b6abed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.926381:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f1200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864058.926384:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000119c7244/0xf569beb9d4b6abed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.926403:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000119c7244/0xf569beb9d4b6abed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.926417:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000119c7244/0xf569beb9d4b6abed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.926425:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000119c7244/0xf569beb9d4b6abed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.926438:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.926439:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.926441:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788864058.927824:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788864058.927834:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6abf4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.927856:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1788864058.927860:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864058.927866:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6abf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.927879:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6abf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.927887:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6abf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.927895:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6abf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.927913:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788864058.927923:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864058.927928:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6abf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.927934:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f1a00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788864058.927938:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6abf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.928356:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6abf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.928384:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6abf4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.928401:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6abf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.928740:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.928742:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.928745:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788864058.930165:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788864058.930176:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97d7503/0xf569beb9d4b6abfb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.930191:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1788864058.930195:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864058.930201:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e97d7503/0xf569beb9d4b6abfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.930214:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e97d7503/0xf569beb9d4b6abfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.930223:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97d7503/0xf569beb9d4b6abfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.930231:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e97d7503/0xf569beb9d4b6abfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.930269:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864058.930509:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864058.930517:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e97d7503/0xf569beb9d4b6abfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.930525:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f1e00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864058.930530:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97d7503/0xf569beb9d4b6abfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.930538:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97d7503/0xf569beb9d4b6abfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.930554:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e97d7503/0xf569beb9d4b6abfb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.930584:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e97d7503/0xf569beb9d4b6abfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.930605:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.930606:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.930608:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788864058.931167:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788864058.931174:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084f6a202/0xf569beb9d4b6ac02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.931185:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1788864058.931189:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864058.931194:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084f6a202/0xf569beb9d4b6ac02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.931205:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084f6a202/0xf569beb9d4b6ac02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.931213:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084f6a202/0xf569beb9d4b6ac02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.931221:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084f6a202/0xf569beb9d4b6ac02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.931245:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788864058.931923:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864058.931931:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084f6a202/0xf569beb9d4b6ac02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.931941:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e54357d200 already unused, calling callback (ffffffffc0e79930) 00002000:00010000:0.0:1788864058.932281:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788864058.932293:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e26cbfe/0xf569beb9d4b6ac09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.932303:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1788864058.932307:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864058.932313:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e26cbfe/0xf569beb9d4b6ac09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.932325:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e26cbfe/0xf569beb9d4b6ac09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.932334:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e26cbfe/0xf569beb9d4b6ac09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.932341:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e26cbfe/0xf569beb9d4b6ac09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.932357:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788864058.933866:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788864058.933877:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bbcb21b/0xf569beb9d4b6ac10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.933893:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1788864058.933898:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864058.933903:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bbcb21b/0xf569beb9d4b6ac10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.933915:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bbcb21b/0xf569beb9d4b6ac10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.933933:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bbcb21b/0xf569beb9d4b6ac10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.933941:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bbcb21b/0xf569beb9d4b6ac10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.933962:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788864058.933971:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788864058.933979:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e26cbfe/0xf569beb9d4b6ac09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.933989:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be0800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864058.933995:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e26cbfe/0xf569beb9d4b6ac09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.934006:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e26cbfe/0xf569beb9d4b6ac09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.934025:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e26cbfe/0xf569beb9d4b6ac09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.934041:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e26cbfe/0xf569beb9d4b6ac09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.934064:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864058.934068:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bbcb21b/0xf569beb9d4b6ac10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.934145:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084f6a202/0xf569beb9d4b6ac02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.934155:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084f6a202/0xf569beb9d4b6ac02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.934167:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084f6a202/0xf569beb9d4b6ac02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.934175:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084f6a202/0xf569beb9d4b6ac02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.934189:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.934191:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.934193:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.934201:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.935233:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be0e00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864058.935244:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bbcb21b/0xf569beb9d4b6ac10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.935256:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bbcb21b/0xf569beb9d4b6ac10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.935269:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bbcb21b/0xf569beb9d4b6ac10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.935276:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bbcb21b/0xf569beb9d4b6ac10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.935293:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.935295:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.935297:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864058.936892:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864058.936905:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ac17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.936926:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1788864058.936930:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864058.936936:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ac17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.936952:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ac17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.936963:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ac17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.936971:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ac17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.936991:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788864058.937115:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864058.937123:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ac17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.937142:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788864058.937147:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ac17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.937155:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ac17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.937170:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ac17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.937176:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd3e9c6/0xf569beb9d4b6ac17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.937192:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.937194:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.937196:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864058.942003:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864058.942018:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccaafe72/0xf569beb9d4b6ac1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.942036:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1788864058.942041:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864058.942047:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccaafe72/0xf569beb9d4b6ac1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.942060:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccaafe72/0xf569beb9d4b6ac1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.942188:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccaafe72/0xf569beb9d4b6ac1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.942198:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccaafe72/0xf569beb9d4b6ac1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.942217:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788864058.943403:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864058.943413:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943425:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1788864058.943429:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864058.943434:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943445:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943469:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943477:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943511:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788864058.943530:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788864058.943537:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccaafe72/0xf569beb9d4b6ac1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943545:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864058.943550:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccaafe72/0xf569beb9d4b6ac1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943570:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccaafe72/0xf569beb9d4b6ac1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943589:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccaafe72/0xf569beb9d4b6ac1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943732:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccaafe72/0xf569beb9d4b6ac1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943752:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864058.943755:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943761:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864058.943764:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943781:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943792:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943798:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.943809:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.943810:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.943811:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.944474:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788864058.946515:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788864058.946525:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6ac2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.946543:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1788864058.946548:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864058.946555:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6ac2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.946611:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6ac2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.946622:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6ac2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.946630:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6ac2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.946714:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788864058.946727:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864058.946734:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6ac2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.946743:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f1a00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788864058.946759:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6ac2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.946769:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6ac2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.946786:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6ac2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.946809:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033e68fa2/0xf569beb9d4b6ac2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.946832:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.946834:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.946835:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788864058.949214:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788864058.949226:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003766ede9/0xf569beb9d4b6ac33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.949241:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1788864058.949246:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864058.949251:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003766ede9/0xf569beb9d4b6ac33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.949263:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003766ede9/0xf569beb9d4b6ac33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.949272:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003766ede9/0xf569beb9d4b6ac33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.949279:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003766ede9/0xf569beb9d4b6ac33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.949298:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788864058.949393:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864058.949401:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003766ede9/0xf569beb9d4b6ac33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.949411:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f0200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864058.949416:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003766ede9/0xf569beb9d4b6ac33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.949425:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003766ede9/0xf569beb9d4b6ac33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.949442:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003766ede9/0xf569beb9d4b6ac33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.949461:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003766ede9/0xf569beb9d4b6ac33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.949483:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.949485:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.949486:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788864058.953289:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788864058.953301:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.953318:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1788864058.953323:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864058.953329:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.953343:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.953353:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.953360:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.953382:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788864058.953394:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864058.953405:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.953434:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788864058.953439:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.953448:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.953469:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.953476:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbbc19fd/0xf569beb9d4b6ac3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.953498:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.953500:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.953502:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788864058.963149:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788864058.963165:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c051bb6/0xf569beb9d4b6ac41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.963185:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1788864058.963190:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864058.963197:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c051bb6/0xf569beb9d4b6ac41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.963212:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c051bb6/0xf569beb9d4b6ac41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.963222:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c051bb6/0xf569beb9d4b6ac41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.963229:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c051bb6/0xf569beb9d4b6ac41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.963249:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788864058.964375:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788864058.964386:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050169c77/0xf569beb9d4b6ac48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.964405:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1788864058.964409:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864058.964415:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050169c77/0xf569beb9d4b6ac48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.964426:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050169c77/0xf569beb9d4b6ac48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.964435:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050169c77/0xf569beb9d4b6ac48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.964442:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050169c77/0xf569beb9d4b6ac48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.965393:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864058.965405:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c051bb6/0xf569beb9d4b6ac41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.965417:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167dc00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864058.965422:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c051bb6/0xf569beb9d4b6ac41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.965432:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c051bb6/0xf569beb9d4b6ac41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.965452:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c051bb6/0xf569beb9d4b6ac41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.965459:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c051bb6/0xf569beb9d4b6ac41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.965479:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.965489:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.965491:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864058.966380:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788864058.967752:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788864058.967769:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050169c77/0xf569beb9d4b6ac48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.967782:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167cc00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:1.0:1788864058.967787:0:23384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050169c77/0xf569beb9d4b6ac48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.967797:0:23384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050169c77/0xf569beb9d4b6ac48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.967818:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050169c77/0xf569beb9d4b6ac48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.967825:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050169c77/0xf569beb9d4b6ac48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864058.967849:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.967851:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788864058.967853:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788864058.970019:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788864058.970032:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6ac4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.970048:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1788864058.970053:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864058.970059:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6ac4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.970072:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6ac4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.970195:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6ac4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.970203:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6ac4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.970223:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788864058.971978:0:22617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864058.971993:0:22617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6ac4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.972007:0:22617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167d200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864058.972012:0:22617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6ac4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.972022:0:22617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6ac4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.972043:0:22617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6ac4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.972050:0:22617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006aad1ee1/0xf569beb9d4b6ac4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.972073:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864058.972104:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864058.972106:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788864058.972831:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788864058.972841:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af7ffd74/0xf569beb9d4b6ac56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.972854:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1788864058.972858:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864058.972864:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af7ffd74/0xf569beb9d4b6ac56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.972875:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af7ffd74/0xf569beb9d4b6ac56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.972884:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af7ffd74/0xf569beb9d4b6ac56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.972892:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af7ffd74/0xf569beb9d4b6ac56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864058.972909:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788864058.973362:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864058.973370:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af7ffd74/0xf569beb9d4b6ac56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.973379:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864058.973384:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af7ffd74/0xf569beb9d4b6ac56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.973394:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af7ffd74/0xf569beb9d4b6ac56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.973409:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af7ffd74/0xf569beb9d4b6ac56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.973416:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af7ffd74/0xf569beb9d4b6ac56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.973434:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.973436:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.973437:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788864058.974957:0:24950:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1788864058.974992:0:24950:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788864058.974999:0:24950:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788864058.975163:0:24435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23375:x1875759226698752:12345-0@lo:5:osp-pre-1-1.0 Request processed in 69901us (70000us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788864058.975174:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788864058.975234:0:23375:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788864058.975242:0:23375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23375:1875759226698752:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788864058.975257:0:23375:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1788864058.975304:0:23375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23375:1875759226698880:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788864058.975335:0:23375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864058.975354:0:23375:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788864058.976065:0:22639:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226698880 00000100:00100000:3.0:1788864058.976087:0:22639:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226698880 00000100:00100000:3.0:1788864058.976141:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788864058.976151:0:22639:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23375:x1875759226698880:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788864058.976215:0:22639:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23375:x1875759226698880:12345-0@lo:900:osp-pre-1-1.0 Request processed in 66us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864058.976223:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788864058.976289:0:23375:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e66d4b8e00 x1875759226698880/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788864074 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864058.976300:0:23375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23375:1875759226698880:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788864058.976647:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788864058.976655:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbe01af7/0xf569beb9d4b6ac5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.976670:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1788864058.976675:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864058.976681:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbe01af7/0xf569beb9d4b6ac5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.976695:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbe01af7/0xf569beb9d4b6ac5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.976703:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbe01af7/0xf569beb9d4b6ac5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.976711:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbe01af7/0xf569beb9d4b6ac5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.976738:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788864058.977592:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788864058.977606:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f19198e6/0xf569beb9d4b6ac64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.977617:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1788864058.977621:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864058.977626:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f19198e6/0xf569beb9d4b6ac64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.977636:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f19198e6/0xf569beb9d4b6ac64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.977645:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f19198e6/0xf569beb9d4b6ac64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.977653:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f19198e6/0xf569beb9d4b6ac64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.977668:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788864058.979274:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788864058.979285:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ccd4f49/0xf569beb9d4b6ac6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979300:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1788864058.979304:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864058.979309:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ccd4f49/0xf569beb9d4b6ac6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979321:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ccd4f49/0xf569beb9d4b6ac6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979339:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ccd4f49/0xf569beb9d4b6ac6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979347:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ccd4f49/0xf569beb9d4b6ac6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979371:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788864058.979387:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788864058.979394:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbe01af7/0xf569beb9d4b6ac5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979401:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be0a00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864058.979406:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbe01af7/0xf569beb9d4b6ac5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979415:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbe01af7/0xf569beb9d4b6ac5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979432:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbe01af7/0xf569beb9d4b6ac5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979439:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbe01af7/0xf569beb9d4b6ac5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979465:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788864058.979475:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f19198e6/0xf569beb9d4b6ac64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979482:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be1800 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864058.979485:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f19198e6/0xf569beb9d4b6ac64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979492:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f19198e6/0xf569beb9d4b6ac64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979502:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f19198e6/0xf569beb9d4b6ac64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979509:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f19198e6/0xf569beb9d4b6ac64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979521:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788864058.979524:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ccd4f49/0xf569beb9d4b6ac6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979531:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be1600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864058.979533:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ccd4f49/0xf569beb9d4b6ac6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979540:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ccd4f49/0xf569beb9d4b6ac6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979571:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ccd4f49/0xf569beb9d4b6ac6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979578:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ccd4f49/0xf569beb9d4b6ac6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.979591:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.979593:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864058.979594:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864058.979757:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864058.979766:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788864058.981725:0:24136:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788864058.981740:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad1bfae/0xf569beb9d4b6ac72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.981771:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1788864058.981775:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864058.981782:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fad1bfae/0xf569beb9d4b6ac72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.981796:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fad1bfae/0xf569beb9d4b6ac72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.981806:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad1bfae/0xf569beb9d4b6ac72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.981813:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fad1bfae/0xf569beb9d4b6ac72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864058.981853:0:24136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788864058.982211:0:24136:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1788864058.982317:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22655:x1875759226698240:12345-0@lo:5:osp-pre-1-0.0 Request processed in 107019us (107447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864058.982328:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788864058.982394:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22655:1875759226698240:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788864058.982412:0:22655:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788864058.982463:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22655:1875759226699008:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788864058.982499:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864058.982529:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c657000 going to sleep for 11 seconds 00000100:00100000:0.0:1788864058.982606:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226699008 00000100:00100000:0.0:1788864058.982613:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226699008 00000100:00100000:0.0:1788864058.982665:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788864058.982676:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22655:x1875759226699008:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788864058.982715:0:24138:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:2.0:1788864058.983095:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864058.983105:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fad1bfae/0xf569beb9d4b6ac72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.983116:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be0600 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:2.0:1788864058.983120:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad1bfae/0xf569beb9d4b6ac72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.983131:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad1bfae/0xf569beb9d4b6ac72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.983156:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fad1bfae/0xf569beb9d4b6ac72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.983164:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fad1bfae/0xf569beb9d4b6ac72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864058.983185:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.983187:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864058.983188:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864058.990299:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22655:x1875759226699008:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7606us (7779us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788864058.990317:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788864058.990392:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22655:1875759226699008:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788864058.990409:0:22655:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1788864059.056773:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788864059.757969:0:23385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1788864059.807846:0:25305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788864060.077681:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788864060.973233:0:25358:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788864060.976438:0:25358:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788864061.103554:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864061.935584:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226699136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788864061.935661:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864061.935764:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226699136 00000100:00100000:3.0:1788864061.935772:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226699136 00000100:00100000:3.0:1788864061.935837:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788864061.935847:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226699136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788864061.935881:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00080000:0.0:1788864061.948189:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864061.949374:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226699136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13520us (13703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864061.949388:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788864061.949930:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226699136:0@lo:13:osp-pre-0-0.0 00000020:00000004:2.0:1788864062.043711:0:25408:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788864062.043940:0:25408:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788864062.123265:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864062.404996:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864062.405779:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205602176 00000100:00100000:2.0:1788864062.405791:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205602176 00000100:00100000:2.0:1788864062.405841:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 116 00000100:00100000:2.0:1788864062.405850:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2407:x1875759205602176:12345-192.168.204.35@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788864062.405889:0:22623:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d2ec3653-9477-4478-8f1a-11c954453104@192.168.204.35@tcp t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:2.0:1788864062.405917:0:22623:0:(genops.c:1384:class_connect()) connect: client d2ec3653-9477-4478-8f1a-11c954453104, cookie 0xf569beb9d4b6ac79 00000100:00080000:2.0:1788864062.406056:0:22623:0:(import.c:65:import_set_state_nolock()) ffff89e543526800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788864062.406160:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+5:2407:x1875759205602176:12345-192.168.204.35@tcp:250:mount.lustre.0 Request processed in 309us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864062.406182:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 116 00000100:00100000:3.0:1788864062.418504:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864062.418587:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205602304 00000100:00100000:1.0:1788864062.418598:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205602304 00000100:00100000:1.0:1788864062.418659:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 117 00000100:00100000:1.0:1788864062.418687:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+5:18088:x1875759205602304:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788864062.418704:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864062.418723:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b6ac80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188461 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864062.418754:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b6ac80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188461 expref: 6 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864062.418783:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3ec00/0xf569beb9d4b6ac80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188461 expref: 6 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864062.418792:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3ec00, rc 0) 00000100:00100000:1.0:1788864062.418870:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+6:18088:x1875759205602304:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 185us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864062.418878:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 117 00000100:00100000:3.0:1788864062.422963:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864062.424037:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205602432 00000100:00100000:1.0:1788864062.424052:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205602432 00000100:00100000:1.0:1788864062.424172:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 118 00000100:00100000:1.0:1788864062.424182:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+6:18088:x1875759205602432:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788864062.424321:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+6:18088:x1875759205602432:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 140us (1367us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788864062.424330:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 118 00000100:00100000:0.0:1788864062.431282:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864062.431443:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205602560 00000100:00100000:2.0:1788864062.431454:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205602560 00000100:00100000:2.0:1788864062.431521:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 119 00000100:00100000:2.0:1788864062.431532:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+6:18088:x1875759205602560:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788864062.431549:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864062.431565:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e5410f0000/0xf569beb9d4b6ac87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188468 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864062.431594:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e5410f0000/0xf569beb9d4b6ac87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188468 expref: 7 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864062.431604:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e5410f0000/0xf569beb9d4b6ac87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188468 expref: 7 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864062.431612:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f0000, rc 0) 00000100:00100000:2.0:1788864062.431788:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+7:18088:x1875759205602560:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 244us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864062.431796:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 119 00000100:00100000:3.0:1788864062.444239:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864062.446984:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205602688 00000100:00100000:2.0:1788864062.447000:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205602688 00000100:00100000:2.0:1788864062.447092:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 120 00000100:00100000:2.0:1788864062.447104:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+7:18088:x1875759205602688:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788864062.447267:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+8:18088:x1875759205602688:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 165us (3036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864062.447276:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 120 00000100:00100000:3.0:1788864062.456722:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864062.457119:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205602816 00000100:00100000:2.0:1788864062.457131:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205602816 00000100:00100000:2.0:1788864062.457194:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 121 00000100:00100000:2.0:1788864062.457205:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+8:18088:x1875759205602816:12345-192.168.204.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788864062.457365:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+8:18088:x1875759205602816:12345-192.168.204.35@tcp:503:mount.lustre.0 Request processed in 161us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864062.457373:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 121 00000100:00100000:0.0:1788864062.472898:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864062.473010:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205602944 00000100:00100000:2.0:1788864062.473021:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205602944 00000100:00100000:2.0:1788864062.473125:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 122 00000100:00100000:2.0:1788864062.473136:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+8:18106:x1875759205602944:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788864062.473301:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+8:18106:x1875759205602944:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 166us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864062.473310:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 122 00000100:00100000:0.0:1788864062.524820:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864062.525115:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205603072 00000100:00100000:2.0:1788864062.525126:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205603072 00000100:00100000:2.0:1788864062.525186:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 123 00000100:00100000:2.0:1788864062.525196:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+8:18106:x1875759205603072:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788864062.525353:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+8:18106:x1875759205603072:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 158us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864062.525362:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 123 00000100:00100000:3.0:1788864062.528318:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864062.528510:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205603200 00000100:00100000:2.0:1788864062.528521:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205603200 00000100:00100000:2.0:1788864062.528579:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 124 00000100:00100000:2.0:1788864062.528590:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+8:18106:x1875759205603200:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788864062.528766:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+8:18106:x1875759205603200:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 177us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864062.528775:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 124 00000100:00100000:0.0:1788864062.537261:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864062.537631:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205603328 00000100:00100000:2.0:1788864062.537642:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205603328 00000100:00100000:2.0:1788864062.537782:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 125 00000100:00100000:2.0:1788864062.537795:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+8:18088:x1875759205603328:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788864062.537815:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864062.537834:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e5410f0c00/0xf569beb9d4b6ac8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188499 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864062.537878:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e5410f0c00/0xf569beb9d4b6ac8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188499 expref: 9 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864062.537889:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e5410f0c00/0xf569beb9d4b6ac8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188499 expref: 9 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864062.537897:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f0c00, rc 0) 00000100:00100000:2.0:1788864062.537969:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+9:18088:x1875759205603328:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 177us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864062.537977:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 125 00000100:00100000:0.0:1788864062.546195:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864062.546302:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205603456 00000100:00100000:3.0:1788864062.546313:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205603456 00000100:00100000:3.0:1788864062.546397:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:3.0:1788864062.546407:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+9:18088:x1875759205603456:12345-192.168.204.35@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788864062.546434:0:22621:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788864062.546453:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788864062.546457:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788864062.546459:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788864062.546462:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788864062.546464:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788864062.561667:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+9:18088:x1875759205603456:12345-192.168.204.35@tcp:256:mount.lustre.0 Request processed in 15249us (15470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864062.561682:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 126 00000100:00100000:0.0:1788864062.575230:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864062.575350:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205603584 00000100:00100000:1.0:1788864062.575362:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205603584 00000100:00100000:1.0:1788864062.575676:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 127 00000100:00100000:1.0:1788864062.575688:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e680867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+9:18088:x1875759205603584:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788864062.575708:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864062.575744:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6ac95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d251884a0 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864062.575780:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6ac95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884a0 expref: 10 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864062.575793:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6ac95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884a0 expref: 10 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864062.575804:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e200, rc 0) 00000100:00100000:1.0:1788864062.575933:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e680867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+10:18088:x1875759205603584:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 246us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864062.575940:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 127 00000100:00100000:2.0:1788864062.582798:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864062.583065:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205603712 00000100:00100000:0.0:1788864062.583138:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205603712 00000100:00100000:0.0:1788864062.583204:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 128 00000100:00100000:0.0:1788864062.583214:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+10:18088:x1875759205603712:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788864062.583577:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+10:18088:x1875759205603712:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 363us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864062.583586:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 128 00000100:00100000:3.0:1788864062.591477:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864062.591630:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205603840 00000100:00100000:2.0:1788864062.591645:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205603840 00000100:00100000:2.0:1788864062.591721:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 129 00000100:00100000:2.0:1788864062.591730:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+10:18088:x1875759205603840:12345-192.168.204.35@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788864062.592070:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+10:18088:x1875759205603840:12345-192.168.204.35@tcp:503:mount.lustre.0 Request processed in 188us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864062.592125:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 129 00000100:00100000:2.0:1788864062.608593:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864062.617206:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205603968 00000100:00100000:1.0:1788864062.617223:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205603968 00000100:00100000:1.0:1788864062.617652:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 130 00000100:00100000:1.0:1788864062.617664:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+10:18108:x1875759205603968:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788864062.618727:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+10:18108:x1875759205603968:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 1057us (10137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864062.618740:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 130 00000100:00100000:3.0:1788864062.635397:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864062.635537:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205604096 00000100:00100000:0.0:1788864062.635550:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205604096 00000100:00100000:0.0:1788864062.635617:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 131 00000100:00100000:0.0:1788864062.635626:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+10:18108:x1875759205604096:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788864062.635798:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+10:18108:x1875759205604096:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 172us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864062.635806:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 131 00000100:00100000:3.0:1788864062.652917:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864062.653041:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864062.653116:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205604224 00000100:00100000:1.0:1788864062.653128:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205604224 00000100:00100000:1.0:1788864062.653164:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205604480 00000100:00100000:1.0:1788864062.653167:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205604480 00000100:00100000:1.0:1788864062.653182:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:1.0:1788864062.653190:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1875759205604224:12345-192.168.204.35@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788864062.653223:0:22629:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 4e0abd44-6bd0-46c6-b6fe-79602dd710f8@192.168.204.35@tcp t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:1.0:1788864062.653292:0:22629:0:(genops.c:1384:class_connect()) connect: client 4e0abd44-6bd0-46c6-b6fe-79602dd710f8, cookie 0xf569beb9d4b6ac9c 00000004:00100000:1.0:1788864062.653332:0:22629:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788864062.653559:0:22629:0:(import.c:65:import_set_state_nolock()) ffff89e6459ef800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864062.653634:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:2407:x1875759205604224:12345-192.168.204.35@tcp:38:mount.lustre.0 Request processed in 443us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864062.653642:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:1.0:1788864062.653663:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:1.0:1788864062.653667:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1875759205604480:12345-192.168.204.35@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788864062.653684:0:22629:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 4e0abd44-6bd0-46c6-b6fe-79602dd710f8@192.168.204.35@tcp t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:1.0:1788864062.653729:0:22629:0:(genops.c:1384:class_connect()) connect: client 4e0abd44-6bd0-46c6-b6fe-79602dd710f8, cookie 0xf569beb9d4b6aca3 00000004:00100000:1.0:1788864062.653741:0:22629:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788864062.653884:0:22629:0:(import.c:65:import_set_state_nolock()) ffff89e6459ee800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864062.653917:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:2407:x1875759205604480:12345-192.168.204.35@tcp:38:mount.lustre.0 Request processed in 247us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864062.654050:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:2.0:1788864062.669831:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864062.669894:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864062.670035:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205604608 00000100:00100000:3.0:1788864062.670045:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205604608 00000100:00100000:3.0:1788864062.670294:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205604352 00000100:00100000:3.0:1788864062.670298:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205604352 00000100:00100000:1.0:1788864062.670365:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:1.0:1788864062.670389:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:0:x1875759205604608:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788864062.670428:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788864062.670527:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:0:x1875759205604608:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 152us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864062.670534:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00080000:0.0:1788864062.678569:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788864062.678583:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788864062.679589:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:3.0:1788864062.679605:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:0:x1875759205604352:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788864062.679649:0:22629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788864062.685468:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:0:x1875759205604352:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 5854us (15559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864062.685484:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:2.0:1788864062.689116:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864062.691471:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205604736 00000100:00100000:3.0:1788864062.691496:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205604736 00000100:00100000:3.0:1788864062.691580:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:3.0:1788864062.691590:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18088:x1875759205604736:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788864062.691621:0:22630:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788864062.691730:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18088:x1875759205604736:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 140us (2623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864062.691737:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:0.0:1788864062.704465:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864062.704614:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205604864 00000100:00100000:3.0:1788864062.704626:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205604864 00000100:00100000:3.0:1788864062.704699:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:3.0:1788864062.704711:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18088:x1875759205604864:12345-192.168.204.35@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788864062.704820:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18088:x1875759205604864:12345-192.168.204.35@tcp:40:mount.lustre.0 Request processed in 110us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864062.704827:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:2.0:1788864062.709834:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864062.709880:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864062.709927:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864062.710030:0:22639:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205605248 00000100:00100000:1.0:1788864062.710041:0:22639:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205605248 00000100:00100000:1.0:1788864062.710133:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:1.0:1788864062.710144:0:22639:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18088:x1875759205605248:12345-192.168.204.35@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788864062.710248:0:22639:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18088:x1875759205605248:12345-192.168.204.35@tcp:900:mount.lustre.0 Request processed in 106us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864062.710270:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:3.0:1788864062.710908:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205604992 00000100:00100000:3.0:1788864062.710917:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205604992 00000100:00100000:3.0:1788864062.710949:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205605120 00000100:00100000:3.0:1788864062.710952:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205605120 00000100:00100000:3.0:1788864062.710978:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:3.0:1788864062.710995:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2407:x1875759205604992:12345-192.168.204.35@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788864062.711023:0:24136:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4e0abd44-6bd0-46c6-b6fe-79602dd710f8@192.168.204.35@tcp t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:3.0:1788864062.711057:0:24136:0:(genops.c:1384:class_connect()) connect: client 4e0abd44-6bd0-46c6-b6fe-79602dd710f8, cookie 0xf569beb9d4b6acaa 00002000:00100000:3.0:1788864062.711070:0:24136:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4e0abd44-6bd0-46c6-b6fe-79602dd710f8/ffff89e5428cf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788864062.711106:0:24136:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:2.0:1788864062.711303:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:2.0:1788864062.711310:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2407:x1875759205605120:12345-192.168.204.35@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788864062.711328:0:24137:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4e0abd44-6bd0-46c6-b6fe-79602dd710f8@192.168.204.35@tcp t0 exp 0000000000000000 cur 729 last 0 00000020:00000080:2.0:1788864062.711346:0:24137:0:(genops.c:1384:class_connect()) connect: client 4e0abd44-6bd0-46c6-b6fe-79602dd710f8, cookie 0xf569beb9d4b6acb1 00002000:00100000:2.0:1788864062.711352:0:24137:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4e0abd44-6bd0-46c6-b6fe-79602dd710f8/ffff89e543524000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788864062.711365:0:24137:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788864062.711527:0:24137:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788864062.711558:0:24137:0:(import.c:65:import_set_state_nolock()) ffff89e543520000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788864062.711613:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:2407:x1875759205605120:12345-192.168.204.35@tcp:8:mount.lustre.0 Request processed in 301us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864062.711620:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00002000:00080000:3.0:1788864062.711893:0:24136:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788864062.711911:0:24136:0:(import.c:65:import_set_state_nolock()) ffff89e5428ca000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788864062.711940:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:2407:x1875759205604992:12345-192.168.204.35@tcp:8:mount.lustre.0 Request processed in 944us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864062.711947:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:2.0:1788864062.724737:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864062.725016:0:22631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205605376 00000100:00100000:3.0:1788864062.725038:0:22631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205605376 00000100:00100000:3.0:1788864062.725179:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:3.0:1788864062.725191:0:22631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18088:x1875759205605376:12345-192.168.204.35@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788864062.732103:0:22631:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6804us 00000004:00200000:3.0:1788864062.752092:0:22631:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788864062.752237:0:22631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18088:x1875759205605376:12345-192.168.204.35@tcp:33:mount.lustre.0 Request processed in 27044us (27507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864062.752248:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:0.0:1788864062.955592:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226699264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788864062.955672:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864062.956253:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226699264 00000100:00100000:1.0:1788864062.956263:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226699264 00000100:00100000:1.0:1788864062.956332:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788864062.956341:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226699264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788864062.956365:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788864062.956437:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226699264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864062.956444:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788864062.956541:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226699264:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788864062.956687:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788864063.017296:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864063.017423:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205605504 00000100:00100000:1.0:1788864063.017434:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205605504 00000100:00100000:1.0:1788864063.017510:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:1.0:1788864063.017521:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18131:x1875759205605504:12345-192.168.204.35@tcp:101:mkdir.0 00010000:00010000:1.0:1788864063.017543:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864063.017568:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6acb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251884d1 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864063.017635:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6acbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864063.017649:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6acbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864063.017664:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6acbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864063.017717:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788864063.017734:0:22628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788864063.017793:0:22628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6acbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864063.017834:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6acb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884d1 expref: 8 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864063.017854:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6acbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884d1 expref: 7 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864063.017863:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2000) 00010000:00010000:1.0:1788864063.017866:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788864063.017870:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fa00, rc 0) 00000100:00100000:1.0:1788864063.017937:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:18131:x1875759205605504:12345-192.168.204.35@tcp:101:mkdir.0 Request processed in 419us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864063.017945:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00010000:00010000:2.0:1788864063.147758:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788864063.917721:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788864063.980401:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226699392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788864063.980901:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226699520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788864063.980960:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864063.981043:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226700032:0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.981072:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864063.981116:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226700544:0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.981137:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864063.981154:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226701056:0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.981183:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864063.981205:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788864063.981211:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226699904:0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.981234:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864063.981252:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226700416:0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.981271:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864063.981284:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226700928:0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.981303:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864063.981334:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226700032 00000100:00100000:3.0:1788864063.981354:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226700032 00000100:00100000:3.0:1788864063.981402:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226700544 00000100:00100000:3.0:1788864063.981406:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226700544 00000100:00100000:3.0:1788864063.981422:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226699904 00000100:00100000:3.0:1788864063.981424:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226699904 00000100:00100000:3.0:1788864063.981437:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226700416 00000100:00100000:3.0:1788864063.981440:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226700416 00000100:00100000:3.0:1788864063.981785:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788864063.981794:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226700032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.981879:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226700032:12345-0@lo:400:kworker.0 Request processed in 84us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864063.981887:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788864063.981904:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788864063.981909:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226700544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.981933:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226700544:12345-0@lo:400:kworker.0 Request processed in 24us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864063.981938:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788864063.981948:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788864063.981953:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226699904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.981978:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226699904:12345-0@lo:400:kworker.0 Request processed in 25us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864063.981984:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788864063.981993:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788864063.982000:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226700416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.982037:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226700416:12345-0@lo:400:kworker.0 Request processed in 24us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864063.982043:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788864063.982124:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226699904:0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.982135:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226700416:0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.982145:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226700032:0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.982153:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226700544:0@lo:400:kworker.0 00000100:00100000:3.0:1788864063.982210:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226699520 00000100:00100000:3.0:1788864063.982216:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226699520 00000100:00100000:3.0:1788864063.982243:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788864063.982250:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226699520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788864063.982271:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788864063.982309:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226699520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864063.982316:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788864063.982346:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226699520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788864063.982382:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226701056 00000100:00100000:3.0:1788864063.982386:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226701056 00000100:00100000:3.0:1788864063.982411:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226700928 00000100:00100000:3.0:1788864063.982413:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226700928 00000100:00100000:3.0:1788864063.982426:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788864063.982432:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226701056:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788864063.982931:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788864063.982936:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788864063.982938:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788864063.982940:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788864063.983062:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864063.983133:0:22629:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788864063.983142:0:22629:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788864063.983272:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788864063.983280:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226700928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864063.983324:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226700928:12345-0@lo:400:kworker.0 Request processed in 45us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864063.983330:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788864063.983776:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544007100 x1875759226700928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788864063.983790:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226700928:0@lo:400:kworker.0 00000100:00100000:1.0:1788864063.983879:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226701440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788864063.983896:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226699776:0@lo:400:kworker.0 00000100:00100000:1.0:1788864063.983918:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864063.983943:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864063.983957:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226699648:0@lo:400:kworker.0 00000100:00100000:2.0:1788864063.983989:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226700288:0@lo:400:kworker.0 00000100:00100000:1.0:1788864063.983996:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864063.984023:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864063.984034:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226700160:0@lo:400:kworker.0 00000100:00100000:2.0:1788864063.984047:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226700800:0@lo:400:kworker.0 00000100:00100000:0.0:1788864063.984309:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226699392 00000100:00100000:0.0:1788864063.984316:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226699392 00000100:00100000:0.0:1788864063.984368:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226699776 00000100:00100000:0.0:1788864063.984372:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226699776 00000100:00100000:0.0:1788864063.984384:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226700288 00000100:00100000:0.0:1788864063.984387:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226700288 00000100:00100000:0.0:1788864063.984399:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788864063.984405:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875759226699392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788864063.984433:0:23371:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788864063.989766:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864063.989901:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226701312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788864063.989943:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864063.989999:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226701312 00000100:00100000:2.0:1788864063.990011:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226701312 00000100:00100000:2.0:1788864063.990053:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788864063.990063:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226699776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864063.990155:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875759226699776:12345-0@lo:400:kworker.0 Request processed in 91us (6213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864063.990162:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788864063.990185:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788864063.990193:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875759226700288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864063.990223:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875759226700288:12345-0@lo:400:kworker.0 Request processed in 32us (6201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864063.990229:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788864063.990241:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788864063.990248:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226701312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788864063.990280:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788864063.991278:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226701312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1025us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864063.991978:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788864063.992071:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226699776:0@lo:400:kworker.0 00000100:00100000:2.0:1788864063.992108:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226700288:0@lo:400:kworker.0 00000100:00100000:2.0:1788864063.992129:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e66d4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226701312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788864063.992176:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226700800 00000100:00100000:2.0:1788864063.992184:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226700800 00000100:00100000:2.0:1788864063.992257:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788864063.992265:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226700800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864063.992312:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226699648 00000100:00100000:1.0:1788864063.992318:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226699648 00000100:00100000:1.0:1788864063.992365:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788864063.992373:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:3642:x1875759226699648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864063.992420:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:3642:x1875759226699648:12345-0@lo:400:kworker.0 Request processed in 48us (8427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864063.992427:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788864063.992503:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864063.992539:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226700672:0@lo:400:kworker.0 00000100:00100000:1.0:1788864063.992567:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864063.992578:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e544005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226701184:0@lo:400:kworker.0 00000100:00100000:1.0:1788864063.992598:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864063.992620:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226699648:0@lo:400:kworker.0 00000100:00100000:1.0:1788864063.992642:0:25421:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788864063.992652:0:25421:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788864063.992771:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226700160 00000100:00100000:1.0:1788864063.992775:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226700160 00000100:00100000:1.0:1788864063.992791:0:25421:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788864063.992795:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226700672 00000100:00100000:1.0:1788864063.992797:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226700672 00000100:00100000:1.0:1788864063.992805:0:25421:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788864063.992820:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226701184 00000100:00100000:1.0:1788864063.992822:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226701184 00000100:00100000:1.0:1788864063.992837:0:25421:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788864063.992842:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788864063.992847:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226700160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864063.992882:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875759226700160:12345-0@lo:400:kworker.0 Request processed in 34us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864063.992888:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788864063.992897:0:25421:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788864063.992902:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788864063.992906:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226700672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864063.992927:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226700672:12345-0@lo:400:kworker.0 Request processed in 21us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864063.992932:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788864063.992939:0:25421:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788864063.992944:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788864063.992949:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226701184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864063.992971:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226701184:12345-0@lo:400:kworker.0 Request processed in 22us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864063.992976:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788864063.993001:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875759226700160:0@lo:400:kworker.0 00000100:00100000:1.0:1788864063.993012:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226700672:0@lo:400:kworker.0 00010000:00080000:1.0:1788864063.993023:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e544005f80 x1875759226701184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864063.994090:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226700800:12345-0@lo:400:kworker.0 Request processed in 1805us (4312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864063.994104:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788864063.994154:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226700800:0@lo:400:kworker.0 00000100:00100000:2.0:1788864063.994207:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226701440 00000100:00100000:2.0:1788864063.994214:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226701440 00000100:00100000:1.0:1788864063.994231:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226701184:0@lo:400:kworker.0 00000100:00100000:2.0:1788864063.994259:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788864063.994268:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875759226701440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788864063.994444:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788864063.994511:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1875759226701440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 243us (10592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864063.994519:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788864063.994523:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788864063.994530:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864063.994564:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226701440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864063.994591:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226699392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10184us (11527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864063.994597:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226699392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788864063.994604:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788864063.998595:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226701056:12345-0@lo:400:kworker.0 Request processed in 16151us (17399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864063.998612:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788864064.000985:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e544004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226701056:0@lo:400:kworker.0 00010000:00010000:0.0:1788864064.172571:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788864065.008773:0:24950:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4e0abd44-6bd0-46c6-b6fe-79602dd710f8 00000001:00080000:0.0:1788864065.008791:0:24950:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1788864065.195283:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864065.334030:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864065.334207:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205605632 00000100:00100000:1.0:1788864065.334897:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205605632 00000100:00100000:1.0:1788864065.334998:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:1.0:1788864065.335009:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:18183:x1875759205605632:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:1.0:1788864065.335048:0:25421:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788864065.335197:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:18183:x1875759205605632:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 189us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864065.335205:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00080000:0.0:1788864065.337279:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788864065.338826:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864065.339005:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205605760 00000100:00100000:2.0:1788864065.339016:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205605760 00000100:00100000:2.0:1788864065.339208:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:2.0:1788864065.339220:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18183:x1875759205605760:12345-192.168.204.35@tcp:41:lfs.0 00000004:00000024:2.0:1788864065.339265:0:22629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788864065.339759:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18183:x1875759205605760:12345-192.168.204.35@tcp:41:lfs.0 Request processed in 241us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864065.339769:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00080000:0.0:1788864065.339960:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788864065.345125:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864065.345230:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205605888 00000100:00100000:2.0:1788864065.345243:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205605888 00000100:00100000:2.0:1788864065.346048:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:2.0:1788864065.346061:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18183:x1875759205605888:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:2.0:1788864065.346124:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788864065.346221:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18183:x1875759205605888:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 163us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864065.346229:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:2.0:1788864065.351712:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864065.351971:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205606016 00000100:00100000:3.0:1788864065.351982:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205606016 00000100:00080000:0.0:1788864065.352063:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788864065.352067:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864065.360478:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:3.0:1788864065.360496:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:18183:x1875759205606016:12345-192.168.204.35@tcp:13:lfs.0 00002000:00000024:3.0:1788864065.360540:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788864065.360627:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:18183:x1875759205606016:12345-192.168.204.35@tcp:13:lfs.0 Request processed in 136us (8941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864065.360635:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:1.0:1788864065.592245:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864065.592426:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205606144 00000100:00100000:3.0:1788864065.592564:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205606144 00000100:00100000:3.0:1788864065.593226:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 133 00000100:00100000:3.0:1788864065.593239:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+10:18214:x1875759205606144:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788864065.593257:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864065.593288:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d99000/0xf569beb9d4b6acc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d251884d8 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864065.593326:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d99000/0xf569beb9d4b6acc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884d8 expref: 11 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864065.593920:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d99000/0xf569beb9d4b6acc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884d8 expref: 11 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864065.594293:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99000, rc 0) 00000100:00100000:3.0:1788864065.596300:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+11:18214:x1875759205606144:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 3054us (4053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864065.596313:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 133 00000100:00100000:1.0:1788864065.605938:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864065.609028:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205606272 00000100:00100000:0.0:1788864065.609045:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205606272 00000100:00100000:0.0:1788864065.609141:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:0.0:1788864065.609152:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+11:18214:x1875759205606272:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788864065.609962:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+11:18214:x1875759205606272:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 807us (4031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864065.609975:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:2.0:1788864065.613173:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864065.613261:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205606400 00000100:00100000:3.0:1788864065.613271:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205606400 00000100:00100000:3.0:1788864065.613341:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00100000:3.0:1788864065.613351:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+11:18214:x1875759205606400:12345-192.168.204.35@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788864065.613693:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+11:18214:x1875759205606400:12345-192.168.204.35@tcp:503:mount.lustre.0 Request processed in 341us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864065.613709:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00100000:2.0:1788864065.632511:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864065.634133:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205606528 00000100:00100000:1.0:1788864065.634151:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205606528 00000100:00100000:1.0:1788864065.634236:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 136 00000100:00100000:1.0:1788864065.634247:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+11:18221:x1875759205606528:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788864065.634455:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+11:18221:x1875759205606528:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 209us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864065.634463:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 136 00000100:00100000:1.0:1788864065.699309:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864065.699444:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205606656 00000100:00100000:0.0:1788864065.699454:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205606656 00000100:00100000:0.0:1788864065.699527:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 137 00000100:00100000:0.0:1788864065.699537:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+11:18221:x1875759205606656:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788864065.699692:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+11:18221:x1875759205606656:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 156us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864065.699700:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 137 00000100:00100000:2.0:1788864065.703408:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864065.703513:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205606784 00000100:00100000:3.0:1788864065.703523:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205606784 00000100:00100000:3.0:1788864065.703584:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 138 00000100:00100000:3.0:1788864065.703594:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+11:18221:x1875759205606784:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788864065.703762:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+11:18221:x1875759205606784:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 169us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864065.703769:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 138 00000100:00100000:2.0:1788864065.718750:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864065.718859:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205606912 00000100:00100000:1.0:1788864065.718871:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205606912 00000100:00100000:1.0:1788864065.718929:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 139 00000100:00100000:1.0:1788864065.718940:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+11:18214:x1875759205606912:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788864065.718957:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864065.718975:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3f400/0xf569beb9d4b6accd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188509 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864065.719023:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3f400/0xf569beb9d4b6accd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188509 expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864065.719035:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3f400/0xf569beb9d4b6accd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188509 expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864065.719045:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3f400, rc 0) 00000100:00100000:1.0:1788864065.719140:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+12:18214:x1875759205606912:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 202us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864065.719147:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 139 00000100:00100000:1.0:1788864065.727706:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864065.727807:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205607040 00000100:00100000:0.0:1788864065.727818:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205607040 00000100:00100000:0.0:1788864065.727885:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 140 00000100:00100000:0.0:1788864065.727896:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+12:18214:x1875759205607040:12345-192.168.204.35@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788864065.727922:0:22621:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788864065.727950:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788864065.727955:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788864065.727958:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788864065.727961:0:22621:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788864065.727963:0:22621:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788864065.736845:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+12:18214:x1875759205607040:12345-192.168.204.35@tcp:256:mount.lustre.0 Request processed in 8939us (9136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864065.739064:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 140 00000100:00100000:2.0:1788864065.743124:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864065.744037:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205607168 00000100:00100000:3.0:1788864065.744049:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205607168 00000100:00100000:3.0:1788864065.744156:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 141 00000100:00100000:3.0:1788864065.744166:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+12:18214:x1875759205607168:12345-192.168.204.35@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788864065.744184:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864065.744200:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e681d98200/0xf569beb9d4b6acd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188510 expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864065.744230:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e681d98200/0xf569beb9d4b6acd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188510 expref: 13 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864065.744241:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e681d98200/0xf569beb9d4b6acd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188510 expref: 13 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864065.744251:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d98200, rc 0) 00000100:00100000:3.0:1788864065.744332:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+13:18214:x1875759205607168:12345-192.168.204.35@tcp:101:mount.lustre.0 Request processed in 167us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864065.744340:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 141 00000100:00100000:1.0:1788864065.748155:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864065.748280:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205607296 00000100:00100000:0.0:1788864065.748291:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205607296 00000100:00100000:0.0:1788864065.748365:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 142 00000100:00100000:0.0:1788864065.748375:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+13:18214:x1875759205607296:12345-192.168.204.35@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788864065.748533:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+13:18214:x1875759205607296:12345-192.168.204.35@tcp:501:mount.lustre.0 Request processed in 159us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864065.748542:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 142 00000100:00100000:2.0:1788864065.751277:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864065.751487:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205607424 00000100:00100000:1.0:1788864065.751496:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205607424 00000100:00100000:1.0:1788864065.751550:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 143 00000100:00100000:1.0:1788864065.751559:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+13:18214:x1875759205607424:12345-192.168.204.35@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788864065.751712:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+13:18214:x1875759205607424:12345-192.168.204.35@tcp:503:mount.lustre.0 Request processed in 152us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864065.751720:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 143 00000100:00100000:2.0:1788864065.755974:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864065.757599:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205607552 00000100:00100000:3.0:1788864065.757612:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205607552 00000100:00100000:3.0:1788864065.757738:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 144 00000100:00100000:3.0:1788864065.757748:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e679e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+13:18226:x1875759205607552:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788864065.757926:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e679e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+13:18226:x1875759205607552:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 179us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864065.757934:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 144 00000100:00100000:2.0:1788864065.772677:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864065.779512:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205607680 00000100:00100000:0.0:1788864065.779553:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205607680 00000100:00100000:0.0:1788864065.779628:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 145 00000100:00100000:0.0:1788864065.779639:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+13:18226:x1875759205607680:12345-192.168.204.35@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788864065.779806:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+13:18226:x1875759205607680:12345-192.168.204.35@tcp:502:llog_process_th.0 Request processed in 167us (7140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864065.779814:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 145 00000100:00100000:2.0:1788864065.789490:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864065.789811:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205607808 00000100:00100000:3.0:1788864065.789822:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205607808 00000100:00100000:3.0:1788864065.789880:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:3.0:1788864065.789889:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2407:x1875759205607808:12345-192.168.204.35@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788864065.789922:0:22628:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d816ac8c-ee9e-4499-ba04-38b88aa964f3@192.168.204.35@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:3.0:1788864065.789961:0:22628:0:(genops.c:1384:class_connect()) connect: client d816ac8c-ee9e-4499-ba04-38b88aa964f3, cookie 0xf569beb9d4b6acdb 00000004:00100000:3.0:1788864065.789986:0:22628:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788864065.790122:0:22628:0:(import.c:65:import_set_state_nolock()) ffff89e5428cc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788864065.790204:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:2407:x1875759205607808:12345-192.168.204.35@tcp:38:mount.lustre.0 Request processed in 314us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864065.790211:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:2.0:1788864065.797330:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864065.797564:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205608064 00000100:00100000:1.0:1788864065.797574:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205608064 00000100:00100000:1.0:1788864065.797626:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:1.0:1788864065.797635:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2407:x1875759205608064:12345-192.168.204.35@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788864065.797672:0:25421:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from d816ac8c-ee9e-4499-ba04-38b88aa964f3@192.168.204.35@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:1.0:1788864065.797709:0:25421:0:(genops.c:1384:class_connect()) connect: client d816ac8c-ee9e-4499-ba04-38b88aa964f3, cookie 0xf569beb9d4b6ace2 00000004:00100000:1.0:1788864065.797740:0:25421:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788864065.797826:0:25421:0:(import.c:65:import_set_state_nolock()) ffff89e67e2d8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864065.797914:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:2407:x1875759205608064:12345-192.168.204.35@tcp:38:mount.lustre.0 Request processed in 279us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864065.797923:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:1.0:1788864065.803333:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864065.803377:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864065.803511:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205608192 00000100:00100000:3.0:1788864065.803523:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205608192 00000100:00100000:3.0:1788864065.803612:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205607936 00000100:00100000:3.0:1788864065.803616:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205607936 00000100:00100000:3.0:1788864065.803643:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:3.0:1788864065.803652:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:0:x1875759205608192:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788864065.803689:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788864065.803759:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:0:x1875759205608192:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 108us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864065.803781:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:3.0:1788864065.803800:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:3.0:1788864065.803806:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:0:x1875759205607936:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788864065.803817:0:22628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788864065.803842:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:0:x1875759205607936:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 36us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864065.803860:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00080000:0.0:1788864065.803929:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788864065.803934:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788864065.812200:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864065.812539:0:25422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205608320 00000100:00100000:2.0:1788864065.812550:0:25422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205608320 00000100:00100000:2.0:1788864065.812613:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:2.0:1788864065.812623:0:25422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:18214:x1875759205608320:12345-192.168.204.35@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788864065.812658:0:25422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788864065.812743:0:25422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:18214:x1875759205608320:12345-192.168.204.35@tcp:41:mount.lustre.0 Request processed in 121us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864065.812750:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:2.0:1788864065.815719:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864065.815967:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205608448 00000100:00100000:1.0:1788864065.815976:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205608448 00000100:00100000:1.0:1788864065.816044:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:1.0:1788864065.816054:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:18214:x1875759205608448:12345-192.168.204.35@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788864065.816172:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:18214:x1875759205608448:12345-192.168.204.35@tcp:40:mount.lustre.0 Request processed in 119us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864065.816179:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:1.0:1788864065.818792:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864065.818878:0:22639:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205608832 00000100:00100000:3.0:1788864065.818888:0:22639:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205608832 00000100:00100000:3.0:1788864065.818942:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:3.0:1788864065.818954:0:22639:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:18214:x1875759205608832:12345-192.168.204.35@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788864065.819402:0:22639:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:18214:x1875759205608832:12345-192.168.204.35@tcp:900:mount.lustre.0 Request processed in 449us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864065.819412:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:0.0:1788864065.824787:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864065.824899:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864065.825993:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205608576 00000100:00100000:1.0:1788864065.826005:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205608576 00000100:00100000:1.0:1788864065.826060:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205608704 00000100:00100000:1.0:1788864065.826064:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205608704 00000100:00100000:1.0:1788864065.826123:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:1.0:1788864065.826131:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2407:x1875759205608576:12345-192.168.204.35@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788864065.826166:0:24138:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d816ac8c-ee9e-4499-ba04-38b88aa964f3@192.168.204.35@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:1.0:1788864065.826200:0:24138:0:(genops.c:1384:class_connect()) connect: client d816ac8c-ee9e-4499-ba04-38b88aa964f3, cookie 0xf569beb9d4b6ace9 00002000:00100000:1.0:1788864065.826211:0:24138:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d816ac8c-ee9e-4499-ba04-38b88aa964f3/ffff89e67e2dd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788864065.826222:0:24138:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788864065.826335:0:24138:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788864065.826386:0:24138:0:(import.c:65:import_set_state_nolock()) ffff89e67e2df800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864065.826467:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:2407:x1875759205608576:12345-192.168.204.35@tcp:8:mount.lustre.0 Request processed in 334us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864065.826475:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:1.0:1788864065.826493:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:1.0:1788864065.826497:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2407:x1875759205608704:12345-192.168.204.35@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788864065.826513:0:24138:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d816ac8c-ee9e-4499-ba04-38b88aa964f3@192.168.204.35@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:1.0:1788864065.826537:0:24138:0:(genops.c:1384:class_connect()) connect: client d816ac8c-ee9e-4499-ba04-38b88aa964f3, cookie 0xf569beb9d4b6acf0 00002000:00100000:1.0:1788864065.826543:0:24138:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d816ac8c-ee9e-4499-ba04-38b88aa964f3/ffff89e67e2d9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788864065.826550:0:24138:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788864065.826595:0:24138:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788864065.826612:0:24138:0:(import.c:65:import_set_state_nolock()) ffff89e67e2dc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788864065.826635:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:2407:x1875759205608704:12345-192.168.204.35@tcp:8:mount.lustre.0 Request processed in 136us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864065.826642:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:2.0:1788864065.832668:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864065.835501:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205608960 00000100:00100000:0.0:1788864065.835519:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205608960 00000100:00100000:0.0:1788864065.835671:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:0.0:1788864065.835684:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:18214:x1875759205608960:12345-192.168.204.35@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788864065.835777:0:22632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788864065.835897:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:18214:x1875759205608960:12345-192.168.204.35@tcp:33:mount.lustre.0 Request processed in 216us (3239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864065.835905:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:1.0:1788864066.088861:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864066.089119:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205609088 00000100:00100000:2.0:1788864066.089130:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205609088 00000100:00100000:2.0:1788864066.089257:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:2.0:1788864066.089269:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:18250:x1875759205609088:12345-192.168.204.35@tcp:101:mkdir.0 00010000:00010000:2.0:1788864066.089290:0:25421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864066.089326:0:25421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6acf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188541 expref: -99 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864066.089392:0:25421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6acfe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864066.089408:0:25421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6acfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864066.089436:0:25421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6acfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864066.089497:0:25421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788864066.089501:0:25421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788864066.089539:0:25421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6acfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864066.089569:0:25421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6acf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188541 expref: 8 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864066.089599:0:25421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6acfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188541 expref: 7 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864066.089610:0:25421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2000) 00010000:00010000:2.0:1788864066.089613:0:25421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788864066.089617:0:25421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f1200, rc 0) 00000100:00100000:2.0:1788864066.089687:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d816ac8c-ee9e-4499-ba04-38b88aa964f3+7:18250:x1875759205609088:12345-192.168.204.35@tcp:101:mkdir.0 Request processed in 420us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864066.089693:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00010000:00010000:2.0:1788864066.219714:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864067.055210:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788864067.055247:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226701568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788864067.055339:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864067.055949:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226701568 00000100:00100000:3.0:1788864067.055960:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226701568 00000100:00100000:3.0:1788864067.056043:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788864067.056055:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226701568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788864067.056125:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788864067.056207:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226701568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864067.056215:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788864067.056275:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226701568:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788864067.057258:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788864067.244491:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864068.075300:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226701696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788864068.075396:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864068.075527:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226701696 00000100:00100000:1.0:1788864068.075538:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226701696 00000100:00100000:1.0:1788864068.075606:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788864068.075618:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226701696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788864068.075645:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788864068.075698:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226701696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864068.075705:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788864068.075762:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226701696:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788864068.075824:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788864068.267254:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788864068.594436:0:24132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d816ac8c-ee9e-4499-ba04-38b88aa964f3 00000001:00100000:0.0:1788864068.594450:0:24132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4e0abd44-6bd0-46c6-b6fe-79602dd710f8 00000001:00100000:1.0:1788864068.594968:0:23362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d816ac8c-ee9e-4499-ba04-38b88aa964f3 00000001:00100000:1.0:1788864068.594974:0:23362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4e0abd44-6bd0-46c6-b6fe-79602dd710f8 00000001:00100000:1.0:1788864068.595750:0:22608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d816ac8c-ee9e-4499-ba04-38b88aa964f3 00000001:00100000:1.0:1788864068.595759:0:22608:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4e0abd44-6bd0-46c6-b6fe-79602dd710f8 00000100:00100000:1.0:1788864069.099354:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788864069.099387:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226701824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788864069.099460:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864069.099569:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226701952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788864069.099595:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864069.099628:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226701952 00000100:00100000:1.0:1788864069.099635:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226701952 00000100:00100000:1.0:1788864069.099680:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788864069.099688:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226701952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788864069.099722:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788864069.099765:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875759226701952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864069.099773:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788864069.099819:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226701952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788864069.104718:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226701824 00000100:00100000:2.0:1788864069.104736:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226701824 00000100:00100000:2.0:1788864069.104891:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226702080:0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.104971:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864069.105025:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226702592:0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105052:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864069.105069:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226703104:0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105107:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864069.105141:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788864069.105146:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226702208:0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105169:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864069.105187:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226702720:0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105224:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864069.105244:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226703232:0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105346:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864069.105386:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226702464:0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105409:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864069.105428:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226702976:0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105446:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864069.105461:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788864069.105466:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226702336:0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105483:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864069.105498:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226702848:0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105514:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864069.105529:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226703360:0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105552:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864069.105572:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226702080 00000100:00100000:2.0:1788864069.105577:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226702080 00000100:00100000:2.0:1788864069.105618:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788864069.105625:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:3640:x1875759226702080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105672:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:3640:x1875759226702080:12345-0@lo:400:kworker.0 Request processed in 46us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864069.105679:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788864069.105717:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226703104 00000100:00100000:2.0:1788864069.105720:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226703104 00000100:00100000:2.0:1788864069.105745:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226703232 00000100:00100000:2.0:1788864069.105747:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226703232 00000100:00100000:2.0:1788864069.105759:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226702464 00000100:00100000:2.0:1788864069.105761:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226702464 00000100:00100000:2.0:1788864069.105771:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226702976 00000100:00100000:2.0:1788864069.105773:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226702976 00000100:00100000:2.0:1788864069.105784:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226702848 00000100:00100000:2.0:1788864069.105786:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226702848 00000100:00100000:2.0:1788864069.105795:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226703360 00000100:00100000:2.0:1788864069.105797:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226703360 00000100:00100000:2.0:1788864069.105809:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788864069.105815:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226703104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105844:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226703104:12345-0@lo:400:kworker.0 Request processed in 29us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864069.105850:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788864069.105862:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788864069.105868:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226703232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105891:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226703232:12345-0@lo:400:kworker.0 Request processed in 24us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864069.105896:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788864069.105905:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788864069.105910:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226702464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105934:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875759226702464:12345-0@lo:400:kworker.0 Request processed in 24us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864069.105939:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788864069.105950:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788864069.105955:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226702976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.105992:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226702976:12345-0@lo:400:kworker.0 Request processed in 36us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864069.105999:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788864069.106010:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788864069.106014:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226702848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.106036:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226702848:12345-0@lo:400:kworker.0 Request processed in 22us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864069.106041:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788864069.106050:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788864069.106055:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226703360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.106101:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226703360:12345-0@lo:400:kworker.0 Request processed in 46us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864069.106107:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788864069.106124:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226702592 00000100:00100000:2.0:1788864069.106127:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226702592 00000100:00100000:2.0:1788864069.106146:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226702720 00000100:00100000:2.0:1788864069.106149:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226702720 00000100:00100000:2.0:1788864069.106160:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226702336 00000100:00100000:2.0:1788864069.106162:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226702336 00000100:00100000:2.0:1788864069.106174:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788864069.106179:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226702592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864069.106205:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226702592:12345-0@lo:400:kworker.0 Request processed in 26us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864069.106211:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788864069.106220:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788864069.106225:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226702720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864069.106527:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788864069.106537:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226702336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864069.111040:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226702208 00000100:00100000:0.0:1788864069.111052:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226702208 00000100:00100000:0.0:1788864069.111126:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788864069.111134:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226702208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864069.113153:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788864069.113185:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226703616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788864069.113339:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864069.113400:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226703616 00000100:00100000:1.0:1788864069.113421:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226703616 00000100:00100000:1.0:1788864069.113459:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788864069.113469:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226703616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788864069.113505:0:22634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788864069.113550:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875759226703616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864069.113557:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788864069.113604:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226703616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788864069.113630:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788864069.113639:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226703488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788864069.113663:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864069.113685:0:24139:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226703488 00000100:00100000:1.0:1788864069.113689:0:24139:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226703488 00000100:00100000:1.0:1788864069.113709:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788864069.113715:0:24139:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875759226703488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788864069.113732:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788864069.113764:0:24139:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875759226703488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864069.113770:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788864069.113796:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875759226703488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788864069.113828:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226702336:12345-0@lo:400:kworker.0 Request processed in 7293us (8343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864069.113836:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788864069.114334:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788864069.114342:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226701824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788864069.114354:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788864069.114404:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226701824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (14944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864069.114410:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788864069.114471:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788864069.114476:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788864069.114479:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788864069.114481:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788864069.114506:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226703232:0@lo:400:kworker.0 00000100:00100000:3.0:1788864069.114517:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226702080:0@lo:400:kworker.0 00000100:00100000:3.0:1788864069.114528:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226702592:0@lo:400:kworker.0 00010000:00080000:3.0:1788864069.114541:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440eb800 x1875759226703104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864069.114552:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226703104:0@lo:400:kworker.0 00000100:00100000:3.0:1788864069.114598:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226702336:0@lo:400:kworker.0 00000100:00100000:3.0:1788864069.114610:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226702848:0@lo:400:kworker.0 00010000:00080000:3.0:1788864069.114629:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e5440e9180 x1875759226703360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864069.114638:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226703360:0@lo:400:kworker.0 00000100:00100000:3.0:1788864069.114649:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875759226702464:0@lo:400:kworker.0 00000100:00100000:3.0:1788864069.114675:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226702976:0@lo:400:kworker.0 00000100:00100000:1.0:1788864069.115023:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788864069.115045:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226701824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788864069.115350:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226702720:12345-0@lo:400:kworker.0 Request processed in 9122us (10123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864069.115372:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788864069.115638:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226702720:0@lo:400:kworker.0 00000100:00100000:0.0:1788864069.117492:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226702208:12345-0@lo:400:kworker.0 Request processed in 6347us (12310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864069.117508:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788864069.117696:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226702208:0@lo:400:kworker.0 00010000:00010000:1.0:1788864069.297966:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788864069.750409:0:25508:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:2.0:1788864069.996901:0:23385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788864070.315709:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864071.150395:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864071.150501:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864071.150530:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864071.150570:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205609600 00000100:00100000:1.0:1788864071.150581:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205609600 00000100:00100000:1.0:1788864071.150643:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:1.0:1788864071.150655:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2410:x1875759205609600:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788864071.150736:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2410:x1875759205609600:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 84us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864071.150755:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00080000:1.0:1788864071.150781:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788864071.154072:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864071.154112:0:24137:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205610112 00000100:00100000:2.0:1788864071.154121:0:24137:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205610112 00000100:00100000:2.0:1788864071.154181:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:2.0:1788864071.154191:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2410:x1875759205610112:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788864071.154258:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2410:x1875759205610112:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864071.154265:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:2.0:1788864071.154310:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864071.154427:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864071.155231:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205609344 00000100:00100000:0.0:1788864071.155241:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205609344 00000100:00100000:0.0:1788864071.155292:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205609856 00000100:00100000:0.0:1788864071.155296:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205609856 00000100:00100000:0.0:1788864071.155334:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:0.0:1788864071.155342:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:2410:x1875759205609344:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788864071.155394:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:2410:x1875759205609344:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 53us (5010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864071.155401:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:0.0:1788864071.155416:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:0.0:1788864071.155422:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:2410:x1875759205609856:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788864071.155448:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:2410:x1875759205609856:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 26us (4916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864071.155455:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:2.0:1788864071.157424:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864071.157455:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864071.157478:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864071.157506:0:24435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205609728 00000100:00100000:2.0:1788864071.157516:0:24435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205609728 00000100:00100000:2.0:1788864071.157564:0:24435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205610240 00000100:00100000:2.0:1788864071.157567:0:24435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205610240 00000100:00100000:2.0:1788864071.157588:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:2.0:1788864071.157597:0:24435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2410:x1875759205609728:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788864071.157676:0:24435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2410:x1875759205609728:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 80us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864071.157684:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:2.0:1788864071.157806:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:2.0:1788864071.157814:0:24435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:2410:x1875759205610240:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788864071.157838:0:24435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:2410:x1875759205610240:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 25us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864071.157844:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00080000:2.0:1788864071.157867:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788864071.157872:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788864071.157874:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788864071.158138:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205609472 00000100:00100000:0.0:1788864071.158143:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205609472 00000100:00100000:0.0:1788864071.158184:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205609984 00000100:00100000:0.0:1788864071.158187:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205609984 00000100:00080000:2.0:1788864071.158234:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788864071.158260:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:0.0:1788864071.158269:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2410:x1875759205609472:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788864071.158311:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2410:x1875759205609472:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 44us (3883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864071.158374:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:0.0:1788864071.158387:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:0.0:1788864071.158393:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2410:x1875759205609984:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788864071.158416:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2410:x1875759205609984:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 23us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864071.158461:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:0.0:1788864071.160691:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205609216 00000100:00100000:0.0:1788864071.160708:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205609216 00000100:00100000:0.0:1788864071.160771:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 147 00000100:00100000:0.0:1788864071.160780:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+13:2410:x1875759205609216:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1788864071.160855:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+13:2410:x1875759205609216:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 76us (6543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864071.160862:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 147 00010000:00010000:1.0:1788864071.342190:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788864071.660753:0:24950:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d816ac8c-ee9e-4499-ba04-38b88aa964f3 00000100:00100000:2.0:1788864072.171666:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788864072.171689:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226703744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788864072.171770:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864072.173538:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226703744 00000100:00100000:0.0:1788864072.173564:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226703744 00000100:00100000:0.0:1788864072.173648:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788864072.173659:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226703744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788864072.173689:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788864072.173931:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226703744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 273us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864072.173940:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788864072.174013:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788864072.174061:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226703744:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788864072.374202:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864073.199556:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788864073.199583:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226703872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788864073.199661:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864073.200272:0:24139:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226703872 00000100:00100000:1.0:1788864073.200291:0:24139:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226703872 00000100:00100000:1.0:1788864073.200369:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788864073.200379:0:24139:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226703872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788864073.200416:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788864073.200471:0:24139:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226703872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864073.200478:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788864073.200697:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226703872:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788864073.202298:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788864073.260521:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788864073.388016:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788864073.947772:0:25655:0:(class_obd.c:371:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca23d70e0 20000000:00000080:1.0:1788864073.947793:0:25655:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e67e28cc00 uarg=0000000000000000 20000000:01000000:1.0:1788864073.947837:0:25655:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788864073.947844:0:25655:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788864073.947848:0:25655:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788864073.948906:0:25656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788864073.949801:0:25655:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788864073.964423:0:25655:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788864073.964456:0:25655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864073.964732:0:25655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e640031600/0xf569beb9d4b6a962 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a95b expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864073.964741:0:25655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e6808bdc00/0xf569beb9d4b6a970 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a969 expref: 23 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864073.964748:0:25655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e640030000/0xf569beb9d4b6a9af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6a9a8 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864073.964753:0:25655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6ab29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6ab22 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864073.964762:0:25655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6ac95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884a0 expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864073.964770:0:25655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e681d98200/0xf569beb9d4b6acd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188510 expref: 12 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864073.964777:0:25655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864073.964823:0:25655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e681d98200/0xf569beb9d4b6acd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188510 expref: 12 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864073.964841:0:25655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e681d98200/0xf569beb9d4b6acd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188510 expref: 12 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864073.964859:0:25655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875759226704000:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788864073.965037:0:25655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6ac95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884a0 expref: 12 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864073.965053:0:25655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6ac95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884a0 expref: 12 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864073.965062:0:25655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875759226704128:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788864073.965129:0:25655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6ab29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6ab22 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864073.965137:0:25655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6ab29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6ab22 expref: 23 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864073.965147:0:25655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875759226704256:0@lo:104: 00000100:00100000:1.0:1788864073.965199:0:25655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864073.965247:0:22611:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226704256 00010000:00010000:1.0:1788864073.965253:0:25655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e640030000/0xf569beb9d4b6a9af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a9a8 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864073.965255:0:22611:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226704256 00010000:00010000:1.0:1788864073.965261:0:25655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e640030000/0xf569beb9d4b6a9af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a9a8 expref: 23 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864073.965283:0:25655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875759226704384:0@lo:104: 00000100:00100000:1.0:1788864073.965305:0:25655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788864073.967690:0:25655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e6808bdc00/0xf569beb9d4b6a970 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a969 expref: 23 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864073.967707:0:25655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e6808bdc00/0xf569beb9d4b6a970 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a969 expref: 23 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864073.967722:0:25655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875759226704512:0@lo:104: 00000100:00100000:1.0:1788864073.967769:0:25655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864073.967838:0:22611:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226704384 00000100:00100000:3.0:1788864073.967846:0:22611:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226704384 00000100:00100000:3.0:1788864073.967887:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788864073.967895:0:22611:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+4:25655:x1875759226704256:12345-0@lo:104: 00010000:00010000:3.0:1788864073.967908:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6ab29 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864073.967969:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788864073.967976:0:22611:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+4:25655:x1875759226704256:12345-0@lo:104: Request processed in 81us (2777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864073.967982:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788864073.968002:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788864073.968009:0:22611:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:25655:x1875759226704384:12345-0@lo:104: 00010000:00010000:3.0:1788864073.968016:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a9af expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864073.968057:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788864073.968062:0:22611:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:25655:x1875759226704384:12345-0@lo:104: Request processed in 54us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864073.968068:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788864073.970972:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788864073.970987:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6ab29 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.970998:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e6808bd400 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788864073.971003:0:23384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6ab29 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.971032:0:23384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6ab29 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864073.971039:0:23384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6ab29 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864073.971045:0:23384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788864073.971136:0:23384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6ab29 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.971144:0:23384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864073.971172:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6ab29 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.971179:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e6808bd400/0xf569beb9d4b6ab22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6ab29 expref: -99 pid: 24949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.971197:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864073.971200:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a9af expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.971206:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e54357de00 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788864073.971209:0:23384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a9af expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.971215:0:23384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a9af expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864073.971221:0:23384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a9af expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864073.971233:0:23384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788864073.971247:0:23384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a9af expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.971253:0:23384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864073.971284:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a9af expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.971291:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e54357de00/0xf569beb9d4b6a9a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a9af expref: -99 pid: 24131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.971302:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864073.971304:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864073.971306:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864073.971325:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e659d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3643:1875759226704640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788864073.971396:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864073.971462:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e659d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226704768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788864073.971621:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864073.971665:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226704640 00000100:00100000:2.0:1788864073.971672:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226704640 00010000:00010000:2.0:1788864073.971702:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6ab29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6ab22 expref: 24 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864073.971738:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226704768 00000100:00100000:2.0:1788864073.971741:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226704768 00010000:00010000:2.0:1788864073.971757:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e640030000/0xf569beb9d4b6a9af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a9a8 expref: 25 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864073.971773:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788864073.971787:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+25:3643:x1875759226704640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788864073.971801:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864073.971806:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6ab29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6ab22 expref: 25 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.971817:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6ab29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6ab22 expref: 25 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.971838:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864073.971873:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+25:3643:x1875759226704640:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864073.971880:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788864073.971897:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788864073.971903:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:3640:x1875759226704768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788864073.971911:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864073.971914:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e640030000/0xf569beb9d4b6a9af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a9a8 expref: 24 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.971922:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e640030000/0xf569beb9d4b6a9af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a9a8 expref: 24 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.971931:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864073.971955:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:3640:x1875759226704768:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864073.971961:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788864073.972001:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e659d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3640:1875759226704768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788864073.972024:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e659d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3643:1875759226704640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788864073.973546:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788864073.976883:0:25655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e640031600/0xf569beb9d4b6a962 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf569beb9d4b6a95b expref: 23 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864073.976904:0:25655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e640031600/0xf569beb9d4b6a962 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf569beb9d4b6a95b expref: 23 pid: 22621 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864073.976922:0:25655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875759226704896:0@lo:104: 00000100:00100000:0.0:1788864073.976984:0:25655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864073.981349:0:25655:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5428023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864073.981393:0:25655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875759226704000:192.168.204.35@tcp:104: 00000100:00100000:0.0:1788864073.981403:0:25655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875759226704128:192.168.204.35@tcp:104: 00010000:00010000:0.0:1788864073.981415:0:25655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3fc00/0xf569beb9d4b6ab29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6ab22 expref: 23 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864073.981431:0:25655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875759226704256:0@lo:104: 00010000:00010000:0.0:1788864073.981441:0:25655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640030000/0xf569beb9d4b6a9af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a9a8 expref: 22 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864073.981450:0:25655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875759226704384:0@lo:104: 00000100:00100000:0.0:1788864073.984661:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864073.987690:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205610368 00000100:00100000:3.0:1788864073.987721:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205610368 00010000:00010000:3.0:1788864073.987768:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e681d98200/0xf569beb9d4b6acd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188510 expref: 13 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864073.987816:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:3.0:1788864073.987826:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2ec3653-9477-4478-8f1a-11c954453104+13:2409:x1875759205610368:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864073.987842:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864073.987849:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e681d98200/0xf569beb9d4b6acd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188510 expref: 13 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864073.987862:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e681d98200/0xf569beb9d4b6acd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188510 expref: 13 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864073.987879:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e681d98200/0xf569beb9d4b6acd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188510 expref: 13 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864073.987895:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864073.987959:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2ec3653-9477-4478-8f1a-11c954453104+12:2409:x1875759205610368:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 134us (3308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864073.987967:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:2.0:1788864073.993408:0:22611:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226704512 00000100:00100000:2.0:1788864073.993442:0:22611:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226704512 00000100:00100000:2.0:1788864073.993503:0:22611:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226704896 00000100:00100000:2.0:1788864073.993506:0:22611:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226704896 00000100:00100000:2.0:1788864073.993524:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788864073.993542:0:22611:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+4:25655:x1875759226704512:12345-0@lo:104: 00010000:00010000:2.0:1788864073.993563:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a970 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.993685:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788864073.993691:0:22611:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+4:25655:x1875759226704512:12345-0@lo:104: Request processed in 159us (25921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864073.993698:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788864073.993714:0:22611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788864073.993720:0:22611:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:25655:x1875759226704896:12345-0@lo:104: 00010000:00010000:2.0:1788864073.993728:0:22611:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a962 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.993764:0:22611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788864073.993770:0:22611:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+3:25655:x1875759226704896:12345-0@lo:104: Request processed in 51us (16787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864073.993776:0:22611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788864073.993794:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788864073.993800:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a970 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.993807:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e54357c000 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788864073.993812:0:23384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a970 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.993832:0:23384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a970 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864073.993839:0:23384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a970 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864073.993844:0:23384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788864073.993879:0:23384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a970 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.993886:0:23384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864073.993907:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a970 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.993914:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e54357c000/0xf569beb9d4b6a969 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a970 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.993928:0:23384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788864073.993931:0:23384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf569beb9d4b6a962 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.993937:0:23384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e64167d400 already unused, calling callback (ffffffffc147ac20) 10000000:00010000:2.0:1788864073.993939:0:23384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf569beb9d4b6a962 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.993945:0:23384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf569beb9d4b6a962 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788864073.993950:0:23384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf569beb9d4b6a962 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788864073.993961:0:23384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788864073.993975:0:23384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a962 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.993981:0:23384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788864073.993996:0:23384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a962 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.994003:0:23384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff89e64167d400/0xf569beb9d4b6a95b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf569beb9d4b6a962 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.994018:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864073.994020:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788864073.994021:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864073.994039:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e659d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226705024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788864073.994118:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788864073.994125:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864073.994145:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e659d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226705152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788864073.994169:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226705024 00000100:00100000:2.0:1788864073.994173:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226705024 00000100:00100000:3.0:1788864073.994174:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788864073.994192:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e6808bdc00/0xf569beb9d4b6a970 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a969 expref: 22 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864073.994198:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226705152 00000100:00100000:3.0:1788864073.994201:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226705152 00000100:00100000:2.0:1788864073.994213:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788864073.994214:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e640031600/0xf569beb9d4b6a962 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a95b expref: 23 pid: 22621 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864073.994219:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:3641:x1875759226705024:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788864073.994226:0:22613:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788864073.994229:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864073.994233:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e6808bdc00/0xf569beb9d4b6a970 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a969 expref: 23 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864073.994236:0:22613:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788864073.994242:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e6808bdc00/0xf569beb9d4b6a970 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a969 expref: 23 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.994284:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864073.994311:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:3641:x1875759226705024:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864073.994317:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788864073.994329:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788864073.994334:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643883c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:3642:x1875759226705152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788864073.994341:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864073.994346:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e640031600/0xf569beb9d4b6a962 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf569beb9d4b6a95b expref: 22 pid: 22621 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.994354:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e640031600/0xf569beb9d4b6a962 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf569beb9d4b6a95b expref: 22 pid: 22621 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.994364:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864073.994388:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643883c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:3642:x1875759226705152:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864073.994394:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788864073.994448:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e659d5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3642:1875759226705152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788864073.994475:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e659d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3641:1875759226705024:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788864073.994872:0:25655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e6808bdc00/0xf569beb9d4b6a970 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a969 expref: 21 pid: 22623 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864073.994883:0:25655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875759226704512:0@lo:104: 00010000:00010000:0.0:1788864073.994904:0:25655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e640031600/0xf569beb9d4b6a962 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf569beb9d4b6a95b expref: 20 pid: 22621 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864073.994913:0:25655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5438dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25655:1875759226704896:0@lo:104: 00010000:00010000:0.0:1788864073.994943:0:25655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864073.997392:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864073.998167:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205610496 00000100:00100000:0.0:1788864073.998180:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205610496 00010000:00010000:0.0:1788864073.998224:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6ac95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884a0 expref: 12 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864073.998284:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:0.0:1788864073.998295:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2ec3653-9477-4478-8f1a-11c954453104+12:2409:x1875759205610496:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864073.998309:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864073.998315:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6ac95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884a0 expref: 12 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864073.998329:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6ac95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884a0 expref: 12 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864073.998346:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3e200/0xf569beb9d4b6ac95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884a0 expref: 12 pid: 22622 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864073.998363:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864073.998373:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864073.998412:0:22613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864073.998420:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864073.998429:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864073.998437:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864073.998443:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e000 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864073.998448:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864073.998456:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864073.998479:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864073.998490:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864073.998564:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2ec3653-9477-4478-8f1a-11c954453104+11:2409:x1875759205610496:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 270us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864073.998583:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00010000:00010000:2.0:1788864073.998959:0:25655:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.998968:0:25655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864073.998975:0:25655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e542a3e000/0xf569beb9d4b6ad05 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864074.219615:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226705408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788864074.219691:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864074.219946:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226705280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788864074.219976:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864074.220029:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e659d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226705536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788864074.220051:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864074.220099:0:24139:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226705280 00000100:00100000:2.0:1788864074.220107:0:24139:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226705280 00000100:00100000:2.0:1788864074.220155:0:24139:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226705536 00000100:00100000:2.0:1788864074.220158:0:24139:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226705536 00000100:00100000:2.0:1788864074.220176:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788864074.220184:0:24139:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226705280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788864074.220212:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788864074.220255:0:24139:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226705280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864074.220275:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788864074.220292:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788864074.220298:0:24139:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226705536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788864074.220307:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788864074.220334:0:24139:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226705536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864074.220339:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788864074.220354:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788864074.220386:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e659d5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226705536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788864074.220415:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226705280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788864074.220696:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226705408 00000100:00100000:3.0:1788864074.220701:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226705408 00000100:00100000:3.0:1788864074.220741:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788864074.220748:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226705408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788864074.220785:0:22634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788864074.220821:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226705408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864074.220828:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788864074.221215:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226705664:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.221280:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864074.221309:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226706176:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.221332:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864074.221351:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226706688:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.221371:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864074.221391:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788864074.221397:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226705792:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.221420:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864074.221436:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226706304:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.221455:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788864074.221567:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226705664 00000100:00100000:1.0:1788864074.221572:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226705664 00000100:00100000:1.0:1788864074.221606:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788864074.221612:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226705664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864074.221968:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226706176 00000100:00100000:0.0:1788864074.221973:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226706176 00000100:00100000:0.0:1788864074.222022:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226706688 00000100:00100000:0.0:1788864074.222026:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226706688 00000100:00100000:0.0:1788864074.222063:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226706304 00000100:00100000:0.0:1788864074.222066:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226706304 00000100:00100000:0.0:1788864074.222101:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788864074.222107:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226706176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788864074.222167:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788864074.222175:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226706688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788864074.222494:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226705664:12345-0@lo:400:kworker.0 Request processed in 881us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864074.222502:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788864074.222685:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226705664:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.222702:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788864074.222710:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226706816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788864074.222736:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864074.222883:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788864074.222893:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226706304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.222929:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875759226706304:12345-0@lo:400:kworker.0 Request processed in 39us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864074.222935:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788864074.222958:0:24435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226705792 00000100:00100000:2.0:1788864074.222962:0:24435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226705792 00000100:00100000:2.0:1788864074.223518:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788864074.223527:0:24435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e659d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226705792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.223565:0:24435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226705792:12345-0@lo:400:kworker.0 Request processed in 41us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864074.223587:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788864074.223622:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226706048:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.223653:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864074.223671:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226706560:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.223690:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864074.223704:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788864074.223710:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226705920:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.223726:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864074.223738:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226706432:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.223753:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864074.223913:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226706048 00000100:00100000:2.0:1788864074.223919:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226706048 00000100:00100000:2.0:1788864074.223943:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788864074.223948:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226706048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.223979:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226706048:12345-0@lo:400:kworker.0 Request processed in 30us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864074.223984:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788864074.224017:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226706560 00000100:00100000:2.0:1788864074.224021:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226706560 00000100:00100000:2.0:1788864074.224043:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226705920 00000100:00100000:2.0:1788864074.224047:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226705920 00000100:00100000:2.0:1788864074.224057:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226706432 00000100:00100000:2.0:1788864074.224060:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226706432 00000100:00100000:2.0:1788864074.224072:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788864074.224097:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226706560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.224125:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875759226706560:12345-0@lo:400:kworker.0 Request processed in 32us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864074.224137:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788864074.224148:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788864074.224154:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226705920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.224183:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875759226705920:12345-0@lo:400:kworker.0 Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864074.224188:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788864074.224199:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788864074.224204:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226706432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.224226:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875759226706432:12345-0@lo:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864074.224231:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788864074.224288:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226705408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788864074.224318:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875759226705920:0@lo:400:kworker.0 00010000:00080000:2.0:1788864074.224329:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0f800 x1875759226706432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788864074.224338:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875759226706432:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.224347:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226706048:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.224354:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875759226706560:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.224380:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54408dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226705792:0@lo:400:kworker.0 00000100:00100000:2.0:1788864074.224391:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875759226706304:0@lo:400:kworker.0 00000100:00100000:0.0:1788864074.224805:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875759226706176:12345-0@lo:400:kworker.0 Request processed in 2696us (3470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864074.224814:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788864074.224840:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788864074.224846:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788864074.224848:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788864074.224991:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875759226706176:0@lo:400:kworker.0 00000100:00100000:1.0:1788864074.225328:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226706816 00000100:00100000:1.0:1788864074.225335:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226706816 00000100:00100000:1.0:1788864074.225413:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788864074.225421:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226706816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788864074.225455:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788864074.225587:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226706816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 167us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864074.225594:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788864074.225732:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226706816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788864074.225789:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e659d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875759226706688:12345-0@lo:400:kworker.0 Request processed in 3615us (4417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864074.225797:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788864074.225931:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e542a0c700 x1875759226706688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788864074.225942:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875759226706688:0@lo:400:kworker.0 00010000:00010000:0.0:1788864074.411413:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788864075.187821:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864075.187939:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205610624 00000100:00100000:0.0:1788864075.187963:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205610624 00000100:00100000:0.0:1788864075.188043:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 148 00000100:00100000:0.0:1788864075.188055:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+11:18102:x1875759205610624:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864075.188235:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864075.188277:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542be0000/0xf569beb9d4b6ad0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188548 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.188317:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542be0000/0xf569beb9d4b6ad0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188548 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.188331:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542be0000/0xf569beb9d4b6ad0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188548 expref: 12 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.188353:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542be0000, rc 0) 00000100:00100000:0.0:1788864075.188442:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+12:18102:x1875759205610624:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 389us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864075.188450:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 148 00000100:00100000:0.0:1788864075.202888:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864075.203053:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205610752 00000100:00100000:2.0:1788864075.203066:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205610752 00000100:00100000:2.0:1788864075.203156:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 149 00000100:00100000:2.0:1788864075.203167:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+12:18102:x1875759205610752:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788864075.203560:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+12:18102:x1875759205610752:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 394us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864075.203568:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 149 00000100:00100000:3.0:1788864075.210558:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864075.211969:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205610880 00000100:00100000:1.0:1788864075.211983:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205610880 00000100:00100000:1.0:1788864075.212055:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 150 00000100:00100000:1.0:1788864075.212066:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+12:18102:x1875759205610880:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864075.212292:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+12:18102:x1875759205610880:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 226us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864075.212302:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 150 00000100:00100000:3.0:1788864075.219634:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864075.228487:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205611008 00000100:00100000:2.0:1788864075.228503:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205611008 00000100:00100000:2.0:1788864075.228582:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 151 00000100:00100000:2.0:1788864075.228593:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+12:18102:x1875759205611008:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864075.228609:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864075.228628:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e5410f1800/0xf569beb9d4b6ad13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518854f expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.228656:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e5410f1800/0xf569beb9d4b6ad13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518854f expref: 13 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.228667:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e5410f1800/0xf569beb9d4b6ad13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518854f expref: 13 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.228675:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f1800, rc 0) 00000100:00100000:2.0:1788864075.228761:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2ec3653-9477-4478-8f1a-11c954453104+13:18102:x1875759205611008:12345-192.168.204.35@tcp:101:ll_cfg_requeue.0 Request processed in 169us (9136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864075.228769:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 151 00000100:00100000:2.0:1788864075.246060:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864075.248038:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205611136 00000100:00100000:0.0:1788864075.248054:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205611136 00000100:00100000:0.0:1788864075.248161:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 152 00000100:00100000:0.0:1788864075.248173:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+13:18102:x1875759205611136:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788864075.248344:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+13:18102:x1875759205611136:12345-192.168.204.35@tcp:501:ll_cfg_requeue.0 Request processed in 173us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864075.248353:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 152 00000100:00100000:3.0:1788864075.251318:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864075.251451:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205611264 00000100:00100000:1.0:1788864075.251461:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205611264 00000100:00100000:1.0:1788864075.251516:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 153 00000100:00100000:1.0:1788864075.251538:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+13:18102:x1875759205611264:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864075.251676:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+13:18102:x1875759205611264:12345-192.168.204.35@tcp:503:ll_cfg_requeue.0 Request processed in 138us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864075.251684:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 153 00010000:00010000:2.0:1788864075.435776:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788864075.819212:0:22625:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788864075.819223:0:22625:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e5429b1000 from 13 10000000:01000000:3.0:1788864075.819238:0:22625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788864075.819702:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b6ad1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.819715:0:22625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b6ad1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.819822:0:22625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b6ad1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864075.819852:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226706944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.819929:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864075.819997:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864075.820154:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226706944 00000100:00100000:2.0:1788864075.820164:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226706944 00000100:00100000:2.0:1788864075.820249:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788864075.820259:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+20:22625:x1875759226706944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788864075.820274:0:22623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864075.820289:0:22623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e5410f0e00/0xf569beb9d4b6ad21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6ad1a expref: -99 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.820317:0:22623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e5410f0e00/0xf569beb9d4b6ad21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6ad1a expref: 21 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.820327:0:22623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e5410f0e00/0xf569beb9d4b6ad21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6ad1a expref: 21 pid: 22623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.820335:0:22623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f0e00, rc 0) 00000100:00100000:2.0:1788864075.820382:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:22625:x1875759226706944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864075.820390:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788864075.820579:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226706944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864075.820593:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b6ad1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ad21 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.820602:0:22625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b6ad1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6ad21 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864075.820661:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.820689:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864075.820723:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864075.820793:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226707072 00000100:00100000:1.0:1788864075.820798:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226707072 00000100:00100000:1.0:1788864075.820830:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788864075.820838:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:22625:x1875759226707072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864075.820957:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:22625:x1875759226707072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864075.820965:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788864075.821109:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.821150:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.821192:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864075.821217:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864075.821459:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226707200 00000100:00100000:0.0:1788864075.821465:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226707200 00000100:00100000:0.0:1788864075.821490:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788864075.821497:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:22625:x1875759226707200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788864075.821586:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:22625:x1875759226707200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864075.821593:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788864075.821858:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788864075.823640:0:25670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788864075.823910:0:22625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788864075.823932:0:22625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788864075.824000:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b6ad1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ad21 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.824025:0:22625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d98200/0xf569beb9d4b6ad1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ad21 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864075.824035:0:22625:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788864075.824037:0:22625:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e659e55000 from 13 10000000:01000000:3.0:1788864075.824040:0:22625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788864075.824072:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b6ad28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.824216:0:22625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b6ad28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.824238:0:22625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b6ad28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864075.824361:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.824420:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864075.824492:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864075.824526:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226707328 00000100:00100000:0.0:1788864075.824534:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226707328 00000100:00100000:0.0:1788864075.824602:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788864075.824610:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+21:22625:x1875759226707328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864075.824622:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864075.824633:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542be0c00/0xf569beb9d4b6ad2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6ad28 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.824654:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542be0c00/0xf569beb9d4b6ad2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6ad28 expref: 22 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.824664:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542be0c00/0xf569beb9d4b6ad2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6ad28 expref: 22 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.824679:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542be0c00, rc 0) 00000100:00100000:0.0:1788864075.824768:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:22625:x1875759226707328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864075.824775:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788864075.824911:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864075.824926:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b6ad28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ad2f expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.824945:0:22625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b6ad28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6ad2f expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864075.825000:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.825025:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864075.825057:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864075.825274:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226707456 00000100:00100000:2.0:1788864075.825279:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226707456 00000100:00100000:2.0:1788864075.825309:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788864075.825316:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:22625:x1875759226707456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788864075.825427:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:22625:x1875759226707456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864075.825440:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788864075.826171:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.826210:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.826377:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864075.826417:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864075.827185:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226707584 00000100:00100000:1.0:1788864075.827194:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226707584 00000100:00100000:1.0:1788864075.827415:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788864075.827425:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:22625:x1875759226707584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864075.827610:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:22625:x1875759226707584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864075.827618:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788864075.837029:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788864075.839992:0:25671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788864075.840342:0:22625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788864075.840369:0:22625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788864075.840381:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b6ad28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ad2f expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.840402:0:22625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d99600/0xf569beb9d4b6ad28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ad2f expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864075.840413:0:22625:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788864075.840416:0:22625:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e54399a800 from 13 10000000:01000000:3.0:1788864075.840419:0:22625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788864075.840459:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b6ad36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.840472:0:22625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b6ad36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.840483:0:22625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b6ad36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864075.840508:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.840585:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864075.840890:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864075.840942:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226707712 00000100:00100000:1.0:1788864075.840949:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226707712 00000100:00100000:1.0:1788864075.841004:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788864075.841016:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645f47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+22:22625:x1875759226707712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788864075.841029:0:22622:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864075.841043:0:22622:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542a3f000/0xf569beb9d4b6ad3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6ad36 expref: -99 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864075.841105:0:22622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542a3f000/0xf569beb9d4b6ad3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6ad36 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864075.841117:0:22622:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542a3f000/0xf569beb9d4b6ad3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6ad36 expref: 23 pid: 22622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864075.841126:0:22622:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3f000, rc 0) 00000100:00100000:1.0:1788864075.841214:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645f47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:22625:x1875759226707712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864075.841221:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788864075.841366:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864075.841381:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b6ad36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ad3d expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.841451:0:22625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b6ad36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6ad3d expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864075.841513:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.841542:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864075.841575:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864075.841604:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226707840 00000100:00100000:0.0:1788864075.841609:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226707840 00000100:00100000:0.0:1788864075.841690:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788864075.841698:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:22625:x1875759226707840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788864075.841813:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:22625:x1875759226707840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864075.841820:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788864075.841898:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.842518:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.842568:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864075.842645:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864075.842737:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226707968 00000100:00100000:1.0:1788864075.842743:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226707968 00000100:00100000:1.0:1788864075.842785:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788864075.842792:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:22625:x1875759226707968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864075.842932:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:22625:x1875759226707968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864075.842939:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788864075.843033:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226707968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788864075.844881:0:25672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788864075.845310:0:22625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788864075.845336:0:22625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788864075.845348:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b6ad36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ad3d expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.845361:0:22625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d98a00/0xf569beb9d4b6ad36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ad3d expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788864075.845372:0:22625:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788864075.845374:0:22625:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89e680890800 from 13 10000000:01000000:3.0:1788864075.845377:0:22625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788864075.845504:0:22625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98c00/0xf569beb9d4b6ad44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.845513:0:22625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff89e681d98c00/0xf569beb9d4b6ad44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.845524:0:22625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff89e681d98c00/0xf569beb9d4b6ad44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864075.845550:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226708096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.845675:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864075.845777:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864075.845829:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226708096 00000100:00100000:0.0:1788864075.845838:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226708096 00000100:00100000:0.0:1788864075.845920:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788864075.845930:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+23:22625:x1875759226708096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788864075.845943:0:22621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864075.845957:0:22621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e542be1400/0xf569beb9d4b6ad4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf569beb9d4b6ad44 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.845983:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e542be1400/0xf569beb9d4b6ad4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf569beb9d4b6ad44 expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.845993:0:22621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e542be1400/0xf569beb9d4b6ad4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf569beb9d4b6ad44 expref: 24 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.846002:0:22621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542be1400, rc 0) 00000100:00100000:0.0:1788864075.846060:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:22625:x1875759226708096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864075.846068:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788864075.846188:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226708096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788864075.846204:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff89e681d98c00/0xf569beb9d4b6ad44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ad4b expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.846214:0:22625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff89e681d98c00/0xf569beb9d4b6ad44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf569beb9d4b6ad4b expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864075.846292:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226708224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.846321:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864075.846549:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864075.848446:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226708224 00000100:00100000:1.0:1788864075.848461:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226708224 00000100:00100000:1.0:1788864075.848531:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788864075.848542:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:22625:x1875759226708224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788864075.848720:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:22625:x1875759226708224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (2398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864075.848728:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788864075.850435:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226708224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.850512:0:22625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226708352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788864075.850592:0:22625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864075.850822:0:22625:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6223c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788864075.850932:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226708352 00000100:00100000:1.0:1788864075.850946:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226708352 00000100:00100000:1.0:1788864075.850988:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788864075.850996:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:22625:x1875759226708352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788864075.851137:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:22625:x1875759226708352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864075.851145:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788864075.851224:0:22625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542ae7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:22625:1875759226708352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788864075.853327:0:25673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788864075.855111:0:22625:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788864075.855150:0:22625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788864075.855162:0:22625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff89e681d98c00/0xf569beb9d4b6ad44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ad4b expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864075.855175:0:22625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff89e681d98c00/0xf569beb9d4b6ad44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf569beb9d4b6ad4b expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864075.883856:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864075.884455:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205611392 00000100:00100000:2.0:1788864075.884469:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205611392 00000100:00100000:2.0:1788864075.884555:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:2.0:1788864075.884568:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:18721:x1875759205611392:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788864075.884594:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864075.884616:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6ad52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188556 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884692:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884708:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884722:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884738:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ad60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884745:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ad60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884752:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ad60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884831:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1e00/0xf569beb9d4b6ad67 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884856:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1e00/0xf569beb9d4b6ad67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884864:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1e00/0xf569beb9d4b6ad67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864075.884897:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788864075.884901:0:22628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788864075.884938:0:22628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1e00/0xf569beb9d4b6ad67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884950:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884957:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884964:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884970:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f1a00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788864075.884974:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884982:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.884996:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2000) 00010000:00010000:2.0:1788864075.884999:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864075.885004:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.885024:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.885037:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ad60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.885043:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ad60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.885049:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ad60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.885054:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f0200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788864075.885057:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ad60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.885063:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ad60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.885071:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff89e54382f500) 00010000:00010000:2.0:1788864075.885121:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864075.885125:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ad60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.885131:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ad60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.885170:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6ad52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188556 expref: 8 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.885195:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1e00/0xf569beb9d4b6ad67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188556 expref: 7 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864075.885203:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e54382fa00) 00010000:00010000:2.0:1788864075.885206:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788864075.885208:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f1e00, rc 0) 00000100:00080000:0.0:1788864075.886655:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864075.886892:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:18721:x1875759205611392:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 731us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864075.886904:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:2.0:1788864075.897774:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864075.897843:0:22639:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205611520 00000100:00100000:3.0:1788864075.897855:0:22639:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205611520 00000100:00100000:3.0:1788864075.897915:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:3.0:1788864075.897925:0:22639:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:18721:x1875759205611520:12345-192.168.204.35@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788864075.898024:0:22639:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:18721:x1875759205611520:12345-192.168.204.35@tcp:900:lhsmtool_posix.0 Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864075.898032:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:3.0:1788864075.905063:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864075.905539:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205611776 00000100:00100000:0.0:1788864075.905551:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205611776 00000100:00100000:0.0:1788864075.905612:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:0.0:1788864075.905623:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:18721:x1875759205611776:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864075.905647:0:22630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864075.905670:0:22630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1c00/0xf569beb9d4b6ad6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518855d expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.905748:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ad75 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.905765:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ad75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.905779:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ad75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.905795:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1200/0xf569beb9d4b6ad7c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.905803:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1200/0xf569beb9d4b6ad7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.905809:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1200/0xf569beb9d4b6ad7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.905921:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1a00/0xf569beb9d4b6ad83 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.905943:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1a00/0xf569beb9d4b6ad83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.905951:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1a00/0xf569beb9d4b6ad83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864075.905962:0:22630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788864075.906183:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ad75 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.906192:0:22630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ad75 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.906198:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ad75 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.906204:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be0400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864075.906209:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ad75 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.906217:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ad75 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.906240:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e54382fa00) 00010000:00010000:0.0:1788864075.906244:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864075.906313:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ad75 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.906322:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ad75 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.906336:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1200/0xf569beb9d4b6ad7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.906349:0:22630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1200/0xf569beb9d4b6ad7c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.906355:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1200/0xf569beb9d4b6ad7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.906360:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be1200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864075.906364:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1200/0xf569beb9d4b6ad7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.906370:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1200/0xf569beb9d4b6ad7c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.906379:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89e6625eb200) 00010000:00010000:0.0:1788864075.906381:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864075.906384:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1200/0xf569beb9d4b6ad7c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.906390:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1200/0xf569beb9d4b6ad7c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.908451:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1c00/0xf569beb9d4b6ad6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518855d expref: 10 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.908477:0:22630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1a00/0xf569beb9d4b6ad83 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518855d expref: 9 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864075.908486:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:0.0:1788864075.908489:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864075.908506:0:22630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542be1a00, rc 0) 00000100:00100000:0.0:1788864075.908581:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+9:18721:x1875759205611776:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 2959us (3529us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788864075.908590:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 24 00000100:00100000:0.0:1788864075.915191:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864075.915346:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205611904 00000100:00100000:2.0:1788864075.915357:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205611904 00000100:00100000:2.0:1788864075.915407:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:2.0:1788864075.915416:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+9:18721:x1875759205611904:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788864075.915527:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+9:18721:x1875759205611904:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 Request processed in 112us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864075.915534:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:2.0:1788864075.925865:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864075.926106:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205612032 00000100:00100000:3.0:1788864075.926116:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205612032 00000100:00100000:3.0:1788864075.926193:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:3.0:1788864075.926205:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:18721:x1875759205612032:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788864075.926269:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788864075.929877:0:22628:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3608us 00000100:00100000:3.0:1788864075.953243:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:18721:x1875759205612032:12345-192.168.204.35@tcp:59:lhsmtool_posix.0 Request processed in 27007us (27358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864075.953259:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:0.0:1788864076.000306:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864076.000424:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205612160 00000100:00100000:2.0:1788864076.000436:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205612160 00000100:00100000:2.0:1788864076.000504:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:2.0:1788864076.000515:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+9:18727:x1875759205612160:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788864076.000538:0:22630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864076.000561:0:22630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ad91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188564 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000651:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000667:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000688:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000752:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6ad9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000761:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6ad9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000772:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6ad9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000815:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000823:0:22630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000829:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000835:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f1a00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788864076.000839:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000856:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000869:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2000) 00010000:00010000:2.0:1788864076.000872:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864076.000878:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000883:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ad98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000896:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6ad9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000902:0:22630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6ad9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000907:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6ad9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000912:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f0400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788864076.000915:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6ad9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000921:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6ad9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000927:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff89e54382f500) 00010000:00010000:2.0:1788864076.000929:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864076.000932:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6ad9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000949:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6ad9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000983:0:22630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ad91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188564 expref: 10 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.000995:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2000) 00010000:00010000:2.0:1788864076.000997:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864076.001001:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ad91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188564 expref: 10 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.001010:0:22630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f0200, rc 0) 00000100:00100000:2.0:1788864076.001155:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+9:18727:x1875759205612160:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 641us (859us total) trans 0 rc 301/301 00000100:00100000:2.0:1788864076.001163:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:0.0:1788864076.020062:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864076.020519:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205612288 00000100:00100000:3.0:1788864076.020543:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205612288 00000100:00100000:3.0:1788864076.020636:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:3.0:1788864076.020659:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+9:18727:x1875759205612288:12345-192.168.204.35@tcp:700:lfs.0 00000100:00100000:3.0:1788864076.020764:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+9:18727:x1875759205612288:12345-192.168.204.35@tcp:700:lfs.0 Request processed in 108us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864076.020772:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:3.0:1788864076.026007:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864076.026586:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205612544 00000100:00100000:2.0:1788864076.026600:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205612544 00000100:00100000:2.0:1788864076.026785:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:2.0:1788864076.026798:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+9:18727:x1875759205612544:12345-192.168.204.35@tcp:36:lfs.0 00010000:00010000:2.0:1788864076.026872:0:25421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864076.026910:0:25421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6acbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251884d1 expref: 9 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.026942:0:25421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2000) 00010000:00010000:2.0:1788864076.026948:0:25421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788864076.027028:0:25421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.027060:0:25421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6acfe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188541 expref: 5 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.027069:0:25421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.027166:0:25421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6acfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188541 expref: 5 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.027181:0:25421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6acfe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188541 expref: 5 pid: 25421 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864076.027199:0:25421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25421:1875759226708480:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788864076.027321:0:25421:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e642ec8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788864076.034173:0:25421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5428ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25421:1875759226708480:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788864076.034207:0:25421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864076.039787:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864076.041045:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205612672 00000100:00100000:2.0:1788864076.041060:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205612672 00010000:00010000:2.0:1788864076.041185:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6acfe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188541 expref: 6 pid: 25421 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864076.041252:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:2.0:1788864076.041265:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:2410:x1875759205612672:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864076.041282:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864076.041308:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6acfe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188541 expref: 6 pid: 25421 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.041325:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6acfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188541 expref: 6 pid: 25421 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.041354:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6acfe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188541 expref: 6 pid: 25421 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.041372:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2000) 00010000:00010000:2.0:1788864076.041377:0:22614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788864076.041505:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788864076.041770:0:22614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.041781:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.041818:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788864076.041949:0:25421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.041958:0:25421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.041986:0:25421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6adad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.041995:0:25421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6adad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.042004:0:25421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6adad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864076.042565:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2410:x1875759205612672:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 1298us (2783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864076.042576:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 15 00010000:00010000:2.0:1788864076.047551:0:25421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6adb4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.047575:0:25421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6adb4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.047588:0:25421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6adb4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788864076.047622:0:25421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099caae7b reply state 0000000095bfc3e7 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6adb4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.047635:0:25421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6adb4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.047643:0:25421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:2.0:1788864076.047646:0:25421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788864076.047650:0:25421:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788864076.047656:0:25421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788864076.047665:0:25421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.047672:0:25421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.047678:0:25421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.047684:0:25421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f0200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788864076.047688:0:25421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.047694:0:25421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.047703:0:25421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e643aa2000) 00010000:00010000:2.0:1788864076.047705:0:25421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864076.047709:0:25421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.047724:0:25421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ada6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788864076.047752:0:25421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099caae7b reply state 0000000095bfc3e7 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6adad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.047760:0:25421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6adad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.047766:0:25421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff89e675672400) 00010000:00010000:2.0:1788864076.047769:0:25421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788864076.047771:0:25421:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788864076.047873:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+10:18727:x1875759205612544:12345-192.168.204.35@tcp:36:lfs.0 Request processed in 21073us (22479us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788864076.047882:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 28 00000040:00080000:2.0:1788864076.141560:0:23385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788864076.199140:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864076.199520:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205612800 00000100:00100000:3.0:1788864076.199531:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205612800 00000100:00100000:3.0:1788864076.199601:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:3.0:1788864076.199610:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+10:18735:x1875759205612800:12345-192.168.204.35@tcp:101:lctl.0 00010000:00010000:3.0:1788864076.199634:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864076.199657:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99200/0xf569beb9d4b6adbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518856b expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.199740:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6adc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.199755:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6adc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.199767:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6adc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788864076.200603:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788864076.200610:0:22628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788864076.200676:0:22628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6adc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.200712:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99200/0xf569beb9d4b6adbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518856b expref: 12 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.200730:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99400/0xf569beb9d4b6adc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518856b expref: 11 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.200739:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e675672a00) 00010000:00010000:3.0:1788864076.200742:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788864076.200747:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99400, rc 0) 00000100:00100000:3.0:1788864076.202018:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+11:18735:x1875759205612800:12345-192.168.204.35@tcp:101:lctl.0 Request processed in 2399us (2877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864076.202028:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:3.0:1788864076.270213:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864076.270282:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864076.270334:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864076.270376:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864076.270409:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864076.270427:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864076.270451:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864076.270622:0:22622:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205613056 00000100:00100000:1.0:1788864076.270639:0:22622:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205613056 00000100:00100000:1.0:1788864076.270729:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 166 00000100:00100000:1.0:1788864076.270742:0:22622:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+13:2408:x1875759205613056:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788864076.270849:0:22622:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2ec3653-9477-4478-8f1a-11c954453104+13:2408:x1875759205613056:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 109us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864076.270859:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 166 00000100:00100000:1.0:1788864076.270902:0:25422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205612928 00000100:00100000:1.0:1788864076.270906:0:25422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205612928 00000100:00100000:1.0:1788864076.270932:0:25422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205613440 00000100:00100000:1.0:1788864076.270935:0:25422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205613440 00000100:00100000:1.0:1788864076.270970:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:1.0:1788864076.270977:0:25422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2408:x1875759205613440:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788864076.271012:0:25422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2408:x1875759205613440:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 36us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864076.271019:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:1.0:1788864076.271030:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:1.0:1788864076.271037:0:25422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:18736:x1875759205612928:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788864076.271063:0:25422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864076.271136:0:25422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b6adc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188572 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.271239:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b6add0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.271259:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b6add0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.271277:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b6add0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864076.271295:0:24435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205613184 00000100:00100000:2.0:1788864076.271312:0:24435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205613184 00000004:00200000:1.0:1788864076.271346:0:25422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788864076.271353:0:25422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1788864076.271370:0:24435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205613696 00000100:00100000:2.0:1788864076.271376:0:24435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205613696 00000004:00010000:1.0:1788864076.271379:0:25422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b6add0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864076.271394:0:24435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205613312 00000100:00100000:2.0:1788864076.271399:0:24435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205613312 00010000:00010000:1.0:1788864076.271417:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b6adc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188572 expref: 7 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864076.271419:0:24435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205613568 00000100:00100000:2.0:1788864076.271427:0:24435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205613568 00010000:00010000:1.0:1788864076.271458:0:25422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fc00/0xf569beb9d4b6add0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188572 expref: 6 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864076.271469:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 19 00010000:00010000:1.0:1788864076.271484:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e675672a00) 00000100:00100000:2.0:1788864076.271492:0:24435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2408:x1875759205613184:12345-192.168.204.35@tcp:400:kworker.0 00010000:00010000:1.0:1788864076.271493:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788864076.271502:0:25422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fc00, rc 0) 00000100:00100000:1.0:1788864076.271535:0:25422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:18736:x1875759205612928:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 496us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864076.271544:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:2.0:1788864076.271584:0:24435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2408:x1875759205613184:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 98us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864076.271594:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:2.0:1788864076.271635:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:2.0:1788864076.271644:0:24435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2408:x1875759205613696:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788864076.271680:0:24435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2408:x1875759205613696:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 38us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864076.271687:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:2.0:1788864076.271701:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:2.0:1788864076.271708:0:24435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2408:x1875759205613312:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788864076.271737:0:24435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2408:x1875759205613312:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 29us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864076.271743:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:2.0:1788864076.271763:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:2.0:1788864076.271775:0:24435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2408:x1875759205613568:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788864076.271819:0:24435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2408:x1875759205613568:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 47us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864076.271827:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00080000:0.0:1788864076.272553:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788864076.272561:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788864076.272566:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788864076.281384:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864076.281578:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205613824 00000100:00100000:2.0:1788864076.281593:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205613824 00000100:00100000:2.0:1788864076.281754:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:2.0:1788864076.281766:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:18736:x1875759205613824:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788864076.281797:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864076.281824:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6add7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188579 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.281914:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6adde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.281953:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6adde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.281969:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6adde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.281983:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ade5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.281992:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.281999:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283324:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6adec lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283352:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6adec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283366:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6adec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864076.283428:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788864076.283433:0:22628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788864076.283462:0:22628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6adec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283478:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6adde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283506:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6adde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283515:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6adde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283523:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f1a00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788864076.283528:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6adde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283539:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6adde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283556:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e675672a00) 00010000:00010000:2.0:1788864076.283559:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864076.283566:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6adde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283572:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6adde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283589:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283595:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ade5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283601:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ade5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.283606:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f1c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788864076.285384:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ade5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.285401:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ade5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.285421:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff89e675672400) 00010000:00010000:2.0:1788864076.285424:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864076.285429:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ade5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.285437:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ade5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.285506:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6add7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188579 expref: 8 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.285522:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6adec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188579 expref: 7 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.285530:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:2.0:1788864076.285532:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788864076.285534:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f0200, rc 0) 00000100:00100000:2.0:1788864076.287568:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+7:18736:x1875759205613824:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 5788us (6184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864076.287583:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:2.0:1788864076.303573:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864076.304340:0:22639:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205613952 00000100:00100000:3.0:1788864076.304355:0:22639:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205613952 00000100:00100000:3.0:1788864076.304432:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:3.0:1788864076.304444:0:22639:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5428ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:18736:x1875759205613952:12345-192.168.204.35@tcp:900:lfs.0 00000100:00100000:3.0:1788864076.304578:0:22639:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5428ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:18736:x1875759205613952:12345-192.168.204.35@tcp:900:lfs.0 Request processed in 135us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864076.304586:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:1.0:1788864076.311020:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864076.311672:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205614208 00000100:00100000:2.0:1788864076.311689:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205614208 00000100:00100000:2.0:1788864076.311773:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 32 00000100:00100000:2.0:1788864076.311802:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+7:18736:x1875759205614208:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788864076.311831:0:22630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864076.311857:0:22630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6adf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188580 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864076.311994:0:22630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788864076.312183:0:22630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6adf3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188580 expref: 9 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.312201:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e675672a00) 00010000:00010000:2.0:1788864076.312204:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788864076.312210:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6adf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188580 expref: 9 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.312237:0:22630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f1200, rc 0) 00000100:00100000:2.0:1788864076.312331:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+8:18736:x1875759205614208:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 531us (1329us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788864076.312338:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 32 00000100:00100000:0.0:1788864076.316790:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864076.316984:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205614464 00000100:00100000:2.0:1788864076.317009:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205614464 00000100:00100000:2.0:1788864076.317151:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:2.0:1788864076.317164:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+8:18736:x1875759205614464:12345-192.168.204.35@tcp:36:lfs.0 00010000:00010000:2.0:1788864076.317259:0:22629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864076.317297:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6adec lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188579 expref: 8 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.317320:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:2.0:1788864076.317345:0:22629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788864076.317375:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ae01 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.317392:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ae01 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.317402:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ae01 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788864076.318239:0:22629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fec2bff8 reply state 00000000b27e3830 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ae01 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.318264:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ae01 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.318273:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:2.0:1788864076.318276:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788864076.318280:0:22629:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788864076.318292:0:22629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788864076.318538:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+9:18736:x1875759205614464:12345-192.168.204.35@tcp:36:lfs.0 Request processed in 1359us (1749us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788864076.318548:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 33 00000100:00100000:0.0:1788864076.329635:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864076.329959:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205614720 00000100:00100000:3.0:1788864076.329975:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205614720 00000100:00100000:3.0:1788864076.330053:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:3.0:1788864076.330066:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+9:18736:x1875759205614720:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:3.0:1788864076.330462:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+10:18736:x1875759205614720:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 398us (853us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788864076.330472:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2 00000040:00080000:2.0:1788864076.332225:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788864076.339357:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864076.339828:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205614976 00000100:00100000:2.0:1788864076.339845:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205614976 00000100:00100000:2.0:1788864076.339933:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:2.0:1788864076.339945:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+10:18736:x1875759205614976:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788864076.339980:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864076.340009:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ae08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188587 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.345826:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.345864:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.346867:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.346895:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.346907:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.346915:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864076.347815:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788864076.347933:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.347944:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.347952:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.347959:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be1e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864076.347964:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.348706:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.348726:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e675672a00) 00010000:00010000:0.0:1788864076.348730:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864076.348736:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.348743:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.348764:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.348769:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.348798:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.348805:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be0200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864076.348809:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.348816:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.348824:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff89e675672400) 00010000:00010000:0.0:1788864076.348826:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864076.348830:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.348836:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.348905:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ae08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188587 expref: 12 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.348918:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e675672a00) 00010000:00010000:0.0:1788864076.348921:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864076.348924:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6ae08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188587 expref: 12 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.348936:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f0200, rc 0) 00000100:00100000:0.0:1788864076.349846:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+11:18736:x1875759205614976:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 9895us (10497us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788864076.349876:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 34 00000100:00100000:1.0:1788864076.362685:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864076.362813:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205615104 00000100:00100000:2.0:1788864076.362829:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205615104 00000100:00100000:2.0:1788864076.362911:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00100000:2.0:1788864076.362925:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d816ac8c-ee9e-4499-ba04-38b88aa964f3+11:18736:x1875759205615104:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788864076.362959:0:25421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864076.363000:0:25421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6ae24 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518858e expref: -99 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.363176:0:25421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ae2b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.363196:0:25421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ae2b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.363212:0:25421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ae2b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864076.363267:0:25421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788864076.363271:0:25421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788864076.363295:0:25421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ae2b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.363331:0:25421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6ae24 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518858e expref: 13 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.363355:0:25421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ae2b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518858e expref: 12 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.363390:0:25421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:2.0:1788864076.363393:0:25421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788864076.363398:0:25421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f1a00, rc 0) 00000100:00100000:2.0:1788864076.363490:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d816ac8c-ee9e-4499-ba04-38b88aa964f3+12:18736:x1875759205615104:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 568us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864076.363499:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 35 00000100:00100000:2.0:1788864076.367316:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864076.367371:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205615232 00000100:00100000:3.0:1788864076.367396:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205615232 00000100:00100000:3.0:1788864076.367475:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:3.0:1788864076.367486:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+12:18736:x1875759205615232:12345-192.168.204.35@tcp:37:lfs.0 00000100:00100000:0.0:1788864076.391580:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d816ac8c-ee9e-4499-ba04-38b88aa964f3+12:18736:x1875759205615232:12345-192.168.204.35@tcp:37:lfs.0 Request processed in 24079us (24261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864076.391595:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:1.0:1788864076.396999:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864076.397273:0:22631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205615488 00000100:00100000:0.0:1788864076.397287:0:22631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205615488 00000100:00100000:0.0:1788864076.397368:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 4 00000100:00100000:0.0:1788864076.397380:0:22631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544073450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+12:18736:x1875759205615488:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:0.0:1788864076.397890:0:22631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544073450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+13:18736:x1875759205615488:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 510us (907us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788864076.397900:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 4 00010000:00010000:3.0:1788864076.459473:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864076.511943:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864076.514377:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205615616 00000100:00100000:0.0:1788864076.514407:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205615616 00000100:00100000:0.0:1788864076.514521:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 36 00000100:00100000:0.0:1788864076.514535:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+11:18742:x1875759205615616:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788864076.514564:0:22629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864076.514593:0:22629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188595 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.514689:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.514708:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.514724:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.514761:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ae40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.514770:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ae40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.514778:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ae40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.514884:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1c00/0xf569beb9d4b6ae47 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.514894:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1c00/0xf569beb9d4b6ae47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.514903:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1c00/0xf569beb9d4b6ae47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864076.514944:0:22629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788864076.514949:0:22629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788864076.514997:0:22629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1c00/0xf569beb9d4b6ae47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515012:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515020:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515028:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515045:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be1e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864076.515051:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515061:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515145:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e675672a00) 00010000:00010000:0.0:1788864076.515149:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864076.515157:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515164:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1e00/0xf569beb9d4b6ae39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515182:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ae40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515188:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ae40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515195:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ae40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515202:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be0400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864076.515205:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ae40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515222:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ae40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515242:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff89e675672400) 00010000:00010000:0.0:1788864076.515245:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864076.515249:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ae40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515255:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6ae40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515292:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188595 expref: 13 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515309:0:22629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1c00/0xf569beb9d4b6ae47 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188595 expref: 12 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864076.515318:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:0.0:1788864076.515321:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788864076.515324:0:22629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542be1c00, rc 0) 00000100:00100000:0.0:1788864076.515428:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+12:18742:x1875759205615616:12345-192.168.204.35@tcp:101:bash.0 Request processed in 897us (3501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864076.515439:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 36 00000100:00100000:1.0:1788864076.520470:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864076.520782:0:22639:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205615744 00000100:00100000:3.0:1788864076.520815:0:22639:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205615744 00000100:00100000:3.0:1788864076.520894:0:22639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:3.0:1788864076.520907:0:22639:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:18742:x1875759205615744:12345-192.168.204.35@tcp:900:bash.0 00000100:00100000:3.0:1788864076.521040:0:22639:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:18742:x1875759205615744:12345-192.168.204.35@tcp:900:bash.0 Request processed in 135us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864076.521049:0:22639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:2.0:1788864076.527794:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864076.528001:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205616000 00000100:00100000:0.0:1788864076.528015:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205616000 00000100:00100000:0.0:1788864076.528463:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 37 00000100:00100000:0.0:1788864076.528485:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54408dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+12:18742:x1875759205616000:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788864076.528521:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864076.528559:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae4e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518859c expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.528854:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.528875:0:22628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ae2b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518858e expref: 12 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.528886:0:22628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.528935:0:22628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ae2b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518858e expref: 12 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.528952:0:22628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ae2b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518858e expref: 12 pid: 25421 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864076.528970:0:22628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22628:1875759226708608:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788864076.529126:0:22628:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6583be540 going to sleep for 11 seconds 00000100:00100000:0.0:1788864076.535535:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864076.535628:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205616128 00000100:00100000:3.0:1788864076.535651:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205616128 00010000:00010000:3.0:1788864076.535707:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ae2b lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518858e expref: 13 pid: 25421 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864076.535759:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 16 00000100:00100000:3.0:1788864076.535772:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+13:2409:x1875759205616128:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864076.535790:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864076.535798:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ae2b lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518858e expref: 13 pid: 25421 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.535813:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ae2b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518858e expref: 13 pid: 25421 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.535842:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:3.0:1788864076.535849:0:22613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.535862:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.535871:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864076.535920:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864076.536002:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d816ac8c-ee9e-4499-ba04-38b88aa964f3+13:2409:x1875759205616128:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 232us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864076.536011:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 16 00010000:00010000:1.0:1788864076.541066:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6ae2b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518858e expref: 12 pid: 25421 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864076.541120:0:22628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22628:1875759226708608:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788864076.541154:0:22628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.541198:0:22628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.541206:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.544684:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6ae5c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.544710:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6ae5c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.544727:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6ae5c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.546054:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6ae63 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.546096:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6ae63 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.546108:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6ae63 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864076.546121:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788864076.547623:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.548951:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.548963:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.548989:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fe00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788864076.548994:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.549004:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.549024:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:1.0:1788864076.549027:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864076.549032:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.549038:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae55 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788864076.549057:0:22628:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002588367c reply state 00000000c230c65a transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6ae5c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.549070:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6ae5c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.549096:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff89e643aa2d00) 00010000:00010000:1.0:1788864076.549099:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788864076.549102:0:22628:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788864076.549193:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0200/0xf569beb9d4b6ae4e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518859c expref: 15 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.549223:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6ae63 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518859c expref: 14 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.549243:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788864076.549246:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788864076.549249:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e400, rc 0) 00000100:00100000:1.0:1788864076.549360:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54408dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+15:18742:x1875759205616000:12345-192.168.204.35@tcp:101:bash.0 Request processed in 20882us (21581us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788864076.549371:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 37 00000100:00100000:2.0:1788864076.569985:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864076.570619:0:25422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205616256 00000100:00100000:1.0:1788864076.570640:0:25422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205616256 00000100:00100000:1.0:1788864076.570793:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 38 00000100:00100000:1.0:1788864076.570806:0:25422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+15:18742:x1875759205616256:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1788864076.570846:0:25422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864076.570869:0:25422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae71 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885a3 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.570942:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6ae78 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.570957:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6ae78 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.570970:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6ae78 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864076.571023:0:25422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788864076.571028:0:25422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788864076.571048:0:25422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6ae78 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.571106:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6ae78 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.571136:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae71 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885a3 expref: 17 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.571176:0:25422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6ae78 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885a3 expref: 16 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.571186:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788864076.571189:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864076.571194:0:25422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e800, rc 0) 00000100:00100000:1.0:1788864076.571307:0:25422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+16:18742:x1875759205616256:12345-192.168.204.35@tcp:101:bash.0 Request processed in 494us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864076.571315:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 38 00000100:00100000:3.0:1788864076.578649:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864076.579425:0:22631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205616512 00000100:00100000:0.0:1788864076.579441:0:22631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205616512 00000100:00100000:0.0:1788864076.579512:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:0.0:1788864076.579524:0:22631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+16:18742:x1875759205616512:12345-192.168.204.35@tcp:35:bash.0 00000100:00100000:0.0:1788864076.582358:0:22631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+17:18742:x1875759205616512:12345-192.168.204.35@tcp:35:bash.0 Request processed in 388us (1281us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788864076.582408:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 5 00000100:00100000:3.0:1788864076.679320:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864076.679509:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205616768 00000100:00100000:1.0:1788864076.679525:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205616768 00000100:00100000:1.0:1788864076.679625:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:1.0:1788864076.679659:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+17:18752:x1875759205616768:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788864076.679701:0:22630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864076.679734:0:22630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885aa expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864076.679892:0:22630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788864076.680049:0:22630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885aa expref: 19 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.680252:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e675672a00) 00010000:00010000:1.0:1788864076.680255:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788864076.680262:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885aa expref: 19 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.680279:0:22630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fe00, rc 0) 00000100:00100000:1.0:1788864076.680369:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+18:18752:x1875759205616768:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 732us (1064us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1788864076.680378:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 39 00000100:00100000:1.0:1788864076.683671:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864076.683788:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205617024 00000100:00100000:2.0:1788864076.683803:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205617024 00000100:00100000:2.0:1788864076.683876:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:2.0:1788864076.683888:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+18:18752:x1875759205617024:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:2.0:1788864076.684326:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+19:18752:x1875759205617024:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 438us (669us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788864076.684335:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 6 00000100:00100000:3.0:1788864076.729336:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864076.731171:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205617280 00000100:00100000:1.0:1788864076.731195:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205617280 00000100:00100000:1.0:1788864076.731314:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 40 00000100:00100000:1.0:1788864076.731327:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+19:18755:x1875759205617280:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:1.0:1788864076.731366:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864076.731399:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae8d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885b1 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.731561:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6ae94 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.731581:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6ae94 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.731596:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6ae94 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864076.731646:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788864076.731789:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6ae8d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885b1 expref: 22 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.731815:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6ae94 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885b1 expref: 21 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.731826:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788864076.731830:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864076.731834:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e600, rc 0) 00000100:00100000:1.0:1788864076.731943:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+21:18755:x1875759205617280:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 619us (2623us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1788864076.731952:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 40 00000100:00100000:3.0:1788864076.736488:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864076.736839:0:25422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205617408 00000100:00100000:1.0:1788864076.736854:0:25422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205617408 00000100:00100000:1.0:1788864076.736934:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 41 00000100:00100000:1.0:1788864076.736946:0:25422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+21:18755:x1875759205617408:12345-192.168.204.35@tcp:54:lfs.0 00000100:00100000:3.0:1788864076.737191:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864076.737496:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205617536 00000100:00100000:2.0:1788864076.737503:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205617536 00000100:00100000:2.0:1788864076.737564:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 0 00000100:00100000:2.0:1788864076.737573:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+22:2409:x1875759205617536:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864076.737593:0:22615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864076.737626:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6ae94 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885b1 expref: 22 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864076.737692:0:22615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:2.0:1788864076.737699:0:22615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864076.737777:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+21:2409:x1875759205617536:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 204us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864076.737785:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 0 00010000:00010000:1.0:1788864076.738829:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6aea2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.738853:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6aea2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.738866:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6aea2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.738913:0:25422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6aea2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.738933:0:25422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6aea2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.738941:0:25422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6aea2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.738947:0:25422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788864076.738952:0:25422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6aea2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.738961:0:25422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6aea2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.738973:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788864076.738976:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788864076.738980:0:25422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6aea2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864076.738986:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6aea2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864076.740433:0:25422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+20:18755:x1875759205617408:12345-192.168.204.35@tcp:54:lfs.0 Request processed in 3471us (3943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864076.740450:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 41 00000100:00100000:3.0:1788864076.756715:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864076.756813:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205617792 00000100:00100000:2.0:1788864076.756828:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205617792 00000100:00100000:2.0:1788864076.756904:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:2.0:1788864076.756917:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+20:18755:x1875759205617792:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:2.0:1788864076.757287:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+21:18755:x1875759205617792:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 372us (586us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788864076.757295:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 7 00000100:00100000:3.0:1788864077.121739:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864077.121884:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205618048 00000100:00100000:2.0:1788864077.121899:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205618048 00000100:00100000:2.0:1788864077.122003:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00100000:2.0:1788864077.122016:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+21:18786:x1875759205618048:12345-192.168.204.35@tcp:101:cat.0 00010000:00010000:2.0:1788864077.122052:0:25421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864077.122146:0:25421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1600/0xf569beb9d4b6aea9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885b8 expref: -99 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.122309:0:25421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aeb0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.122327:0:25421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aeb0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.122370:0:25421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aeb0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864077.122392:0:25421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788864077.122561:0:25421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1600/0xf569beb9d4b6aea9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885b8 expref: 24 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.122585:0:25421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aeb0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885b8 expref: 23 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.122597:0:25421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:2.0:1788864077.122601:0:25421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864077.122605:0:25421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f0600, rc 0) 00000100:00100000:2.0:1788864077.122679:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+23:18786:x1875759205618048:12345-192.168.204.35@tcp:101:cat.0 Request processed in 665us (955us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788864077.122688:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 42 00000100:00080000:0.0:1788864077.123943:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864077.131676:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864077.131824:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205618304 00000100:00100000:2.0:1788864077.131839:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205618304 00000100:00100000:2.0:1788864077.131924:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:2.0:1788864077.131937:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+23:18786:x1875759205618304:12345-192.168.204.35@tcp:35:cat.0 00000100:00100000:2.0:1788864077.135679:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+24:18786:x1875759205618304:12345-192.168.204.35@tcp:35:cat.0 Request processed in 3721us (3998us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788864077.135701:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 8 00000100:00100000:1.0:1788864077.136348:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864077.136924:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205618432 00000100:00100000:3.0:1788864077.136938:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205618432 00000100:00100000:3.0:1788864077.137024:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:3.0:1788864077.137037:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+24:2409:x1875759205618432:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864077.137056:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864077.137141:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aeb0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885b8 expref: 24 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864077.137165:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788864077.137170:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864077.137253:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+23:2409:x1875759205618432:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 219us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864077.137261:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 1 00000100:00100000:1.0:1788864077.263566:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864077.264256:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205618688 00000100:00100000:2.0:1788864077.264273:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205618688 00000100:00100000:2.0:1788864077.264364:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 43 00000100:00100000:2.0:1788864077.264377:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+23:18792:x1875759205618688:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:2.0:1788864077.264433:0:22629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864077.264464:0:22629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1400/0xf569beb9d4b6aebe lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885bf expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.264753:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aec5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.264775:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aec5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.264791:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aec5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864077.264807:0:22629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788864077.264999:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1400/0xf569beb9d4b6aebe lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885bf expref: 26 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.265024:0:22629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aec5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885bf expref: 25 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.265034:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:2.0:1788864077.265037:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864077.265041:0:22629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f1000, rc 0) 00000100:00100000:2.0:1788864077.267416:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+25:18792:x1875759205618688:12345-192.168.204.35@tcp:101:dd.0 Request processed in 3023us (3850us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788864077.267433:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 43 00000100:00100000:2.0:1788864077.274533:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864077.274590:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864077.274708:0:25422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205618816 00000100:00100000:1.0:1788864077.274722:0:25422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205618816 00000100:00100000:1.0:1788864077.274801:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 44 00000100:00100000:1.0:1788864077.274812:0:25422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+25:18792:x1875759205618816:12345-192.168.204.35@tcp:101:dd.0 00010000:00010000:1.0:1788864077.274867:0:25422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864077.274894:0:25422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aed3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885c6 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.274939:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b6aeda lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.274958:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b6aeda lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.274974:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b6aeda lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.275183:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aed3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885c6 expref: 27 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.275219:0:25422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b6aeda lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885c6 expref: 26 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.275230:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788864077.275233:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788864077.275238:0:25422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e000, rc 0) 00000100:00100000:1.0:1788864077.278359:0:25422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+26:18792:x1875759205618816:12345-192.168.204.35@tcp:101:dd.0 Request processed in 3522us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864077.278383:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 44 00000100:00100000:3.0:1788864077.278456:0:22615:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205618944 00000100:00100000:3.0:1788864077.278497:0:22615:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205618944 00000100:00100000:3.0:1788864077.278602:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:3.0:1788864077.278614:0:22615:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+26:2411:x1875759205618944:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864077.278634:0:22615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864077.278681:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aec5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885bf expref: 26 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864077.278706:0:22615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788864077.278713:0:22615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864077.280910:0:22615:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+25:2411:x1875759205618944:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 2280us (6300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864077.280927:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 2 00000100:00100000:0.0:1788864077.290953:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864077.294553:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226708736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788864077.294684:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864077.294822:0:24139:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226708736 00000100:00100000:2.0:1788864077.294832:0:24139:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226708736 00000100:00100000:1.0:1788864077.298295:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205619200 00000100:00100000:1.0:1788864077.298317:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205619200 00000100:00100000:1.0:1788864077.298431:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 45 00000100:00100000:1.0:1788864077.298445:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+25:18792:x1875759205619200:12345-192.168.204.35@tcp:36:dd.0 00010000:00010000:1.0:1788864077.298541:0:22630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864077.298579:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6ae78 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885a3 expref: 25 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.298604:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788864077.298610:0:22630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788864077.300464:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aee1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.300495:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aee1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.300509:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aee1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788864077.300617:0:22630:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1788864077.300737:0:22630:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000449f42f9 reply state 000000009b81b14d transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aee1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.300752:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aee1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.300762:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788864077.300765:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788864077.300769:0:22630:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788864077.300925:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5438df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+27:18792:x1875759205619200:12345-192.168.204.35@tcp:36:dd.0 Request processed in 2479us (9983us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1788864077.300936:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 45 00000020:00080000:1.0:1788864077.300945:0:22630:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1788864077.301569:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788864077.305254:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788864077.305291:0:24139:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e66d4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226708736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788864077.305343:0:24139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788864077.305461:0:24139:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e66d4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875759226708736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (10777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864077.305470:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788864077.305711:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e68086c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875759226708736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788864077.431666:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864077.431952:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205619456 00000100:00100000:2.0:1788864077.432367:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205619456 00000100:00100000:3.0:1788864077.432873:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 9 00000100:00100000:3.0:1788864077.432886:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e68086c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+27:18792:x1875759205619456:12345-192.168.204.35@tcp:35:dd.0 00000100:00100000:3.0:1788864077.433352:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e68086c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+28:18792:x1875759205619456:12345-192.168.204.35@tcp:35:dd.0 Request processed in 466us (1700us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1788864077.433362:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 9 00010000:00010000:0.0:1788864077.485399:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788864077.734898:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864077.735027:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205619584 00000100:00100000:2.0:1788864077.735042:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205619584 00000100:00100000:2.0:1788864077.735242:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 46 00000100:00100000:2.0:1788864077.735256:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+28:18806:x1875759205619584:12345-192.168.204.35@tcp:101:stat.0 00010000:00010000:2.0:1788864077.735292:0:22629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864077.735320:0:22629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1400/0xf569beb9d4b6aee8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885cd expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735422:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aeef lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735443:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aeef lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735459:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aeef lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735501:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aef6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735511:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aef6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735517:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aef6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735612:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1600/0xf569beb9d4b6aefd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735622:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1600/0xf569beb9d4b6aefd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735630:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1600/0xf569beb9d4b6aefd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864077.735686:0:22629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788864077.735691:0:22629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788864077.735741:0:22629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1600/0xf569beb9d4b6aefd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735755:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1600/0xf569beb9d4b6aefd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735765:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aeef lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735773:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aeef lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735794:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aeef lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735800:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f1000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788864077.735805:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aeef lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735815:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aeef lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735831:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:2.0:1788864077.735835:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864077.735841:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aeef lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735848:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6aeef lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735865:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aef6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735871:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aef6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735878:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aef6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735883:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f0600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788864077.735886:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aef6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735902:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aef6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735912:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff89e643aa2d00) 00010000:00010000:2.0:1788864077.735915:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864077.735918:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aef6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735924:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6aef6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735959:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1400/0xf569beb9d4b6aee8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885cd expref: 30 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735976:0:22629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1600/0xf569beb9d4b6aefd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885cd expref: 29 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864077.735984:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:2.0:1788864077.735987:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864077.735990:0:22629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f1600, rc 0) 00000100:00100000:2.0:1788864077.736133:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+29:18806:x1875759205619584:12345-192.168.204.35@tcp:101:stat.0 Request processed in 879us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864077.736141:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 46 00000100:00100000:2.0:1788864077.815234:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864077.815390:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205619840 00000100:00100000:1.0:1788864077.815425:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205619840 00000100:00100000:1.0:1788864077.815506:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 47 00000100:00100000:1.0:1788864077.815518:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+29:18812:x1875759205619840:12345-192.168.204.35@tcp:36:truncate.0 00010000:00010000:1.0:1788864077.815599:0:25421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788864077.815771:0:25421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1600/0xf569beb9d4b6aefd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885cd expref: 29 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.815798:0:25421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788864077.815804:0:25421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788864077.816491:0:25421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6af04 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.816512:0:25421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6af04 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.816523:0:25421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6af04 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788864077.816575:0:25421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1788864077.816600:0:25421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f6b4750 reply state 0000000096fda4db transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6af04 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.816623:0:25421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6af04 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864077.816631:0:25421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788864077.816634:0:25421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788864077.816638:0:25421:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788864077.816788:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+31:18812:x1875759205619840:12345-192.168.204.35@tcp:36:truncate.0 Request processed in 1271us (1568us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788864077.816798:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 47 00000020:00080000:1.0:1788864077.816817:0:25421:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788864078.016332:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864078.016452:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205619968 00000100:00100000:1.0:1788864078.016467:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205619968 00000100:00100000:1.0:1788864078.016554:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:1.0:1788864078.016567:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+31:18826:x1875759205619968:12345-192.168.204.35@tcp:101:stat.0 00010000:00010000:1.0:1788864078.016612:0:22630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864078.016641:0:22630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af0b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885d4 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.016740:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af12 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.016759:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af12 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.016776:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af12 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.016789:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af19 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.016797:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.016804:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.016910:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6af20 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.016920:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6af20 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.016952:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6af20 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864078.017014:0:22630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1788864078.017021:0:22630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788864078.017051:0:22630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6af20 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017067:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6af20 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017275:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af12 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017285:0:22630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af12 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017293:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af12 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017299:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ea00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788864078.017304:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af12 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017313:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af12 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017327:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:1.0:1788864078.017331:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864078.017337:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af12 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017358:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af12 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017378:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017384:0:22630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af19 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017390:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af19 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017396:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fa00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:1.0:1788864078.017399:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af19 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017406:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af19 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017413:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff89e643aa2d00) 00010000:00010000:1.0:1788864078.017416:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788864078.017419:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af19 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017425:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af19 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017462:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af0b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885d4 expref: 33 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017489:0:22630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6af20 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885d4 expref: 32 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.017497:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788864078.017500:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864078.017503:0:22630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e200, rc 0) 00000100:00100000:1.0:1788864078.017599:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+32:18826:x1875759205619968:12345-192.168.204.35@tcp:101:stat.0 Request processed in 1034us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864078.017874:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 48 00000100:00100000:0.0:1788864078.106992:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864078.107272:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205620224 00000100:00100000:2.0:1788864078.107286:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205620224 00000100:00100000:2.0:1788864078.107365:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 49 00000100:00100000:2.0:1788864078.107377:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+32:18836:x1875759205620224:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788864078.107426:0:22629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864078.107456:0:22629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6af27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885db expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864078.107600:0:22629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788864078.107748:0:22629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6af27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885db expref: 34 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.107767:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e675672a00) 00010000:00010000:2.0:1788864078.107771:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788864078.107776:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0600/0xf569beb9d4b6af27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885db expref: 34 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.107793:0:22629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f0600, rc 0) 00000100:00100000:2.0:1788864078.107875:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+33:18836:x1875759205620224:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 501us (900us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1788864078.107883:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 49 00000100:00100000:2.0:1788864078.119365:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.122816:0:22631:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205620480 00000100:00100000:0.0:1788864078.122837:0:22631:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205620480 00000100:00100000:0.0:1788864078.123377:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:0.0:1788864078.123392:0:22631:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544071450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+33:18836:x1875759205620480:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:0.0:1788864078.123717:0:22631:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544071450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+34:18836:x1875759205620480:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 328us (4367us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788864078.123726:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 10 00000100:00100000:1.0:1788864078.218567:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864078.221121:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205620736 00000100:00100000:2.0:1788864078.221145:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205620736 00000100:00100000:2.0:1788864078.221263:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:2.0:1788864078.221277:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+34:18842:x1875759205620736:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:2.0:1788864078.221317:0:25421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864078.221347:0:25421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6af35 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885e2 expref: -99 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.221534:0:25421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.221560:0:25421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6ae63 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518859c expref: 35 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.221569:0:25421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6af20 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885d4 expref: 35 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.221579:0:25421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.221629:0:25421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6af20 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885d4 expref: 35 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.221646:0:25421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6af20 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885d4 expref: 35 pid: 22630 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864078.221664:0:25421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25421:1875759226708864:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788864078.221827:0:25421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6ae63 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518859c expref: 35 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.221837:0:25421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6ae63 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518859c expref: 35 pid: 22628 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864078.221847:0:25421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e54418d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25421:1875759226708992:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788864078.221873:0:25421:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676c0b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788864078.226063:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864078.226696:0:25421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25421:1875759226708864:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788864078.226721:0:25421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e54418d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25421:1875759226708992:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788864078.227211:0:25421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864078.227658:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205620864 00000100:00100000:3.0:1788864078.227673:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205620864 00010000:00010000:3.0:1788864078.227738:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6af20 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885d4 expref: 36 pid: 22630 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864078.227792:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:3.0:1788864078.227804:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643883050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+36:2408:x1875759205620864:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864078.227824:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864078.227831:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6af20 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885d4 expref: 36 pid: 22630 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.227864:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6af20 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885d4 expref: 36 pid: 22630 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.227905:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e200/0xf569beb9d4b6af20 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885d4 expref: 36 pid: 22630 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.227926:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788864078.227932:0:22613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.227942:0:22613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.227950:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864078.228048:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643883050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+35:2408:x1875759205620864:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 245us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864078.228055:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 17 00000100:00100000:2.0:1788864078.228192:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864078.228346:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205620992 00000100:00100000:3.0:1788864078.228351:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205620992 00010000:00010000:3.0:1788864078.230189:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6ae63 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518859c expref: 35 pid: 22628 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864078.230274:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 18 00000100:00100000:3.0:1788864078.230296:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+35:2408:x1875759205620992:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864078.230320:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864078.230329:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6ae63 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518859c expref: 35 pid: 22628 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.230362:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6ae63 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518859c expref: 35 pid: 22628 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.230387:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6ae63 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518859c expref: 35 pid: 22628 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.230407:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788864078.230414:0:22614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.230424:0:22614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.230433:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.230473:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788864078.230533:0:25421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864078.230549:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+34:2408:x1875759205620992:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 263us (2370us total) trans 0 rc 0/0 00010000:00010000:0.0:1788864078.230556:0:25421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864078.230561:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 18 00000004:00200000:0.0:1788864078.230590:0:25421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788864078.230779:0:25421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1000/0xf569beb9d4b6af35 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885e2 expref: 35 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.230796:0:25421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885e2 expref: 34 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.230804:0:25421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788864078.230808:0:25421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788864078.230810:0:25421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f1a00, rc 0) 00000100:00100000:0.0:1788864078.230844:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+34:18842:x1875759205620736:12345-192.168.204.35@tcp:101:bash.0 Request processed in 9570us (12293us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1788864078.230852:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 50 00000100:00100000:2.0:1788864078.236860:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864078.236962:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205621248 00000100:00100000:1.0:1788864078.236977:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205621248 00000100:00100000:1.0:1788864078.237055:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 51 00000100:00100000:1.0:1788864078.237067:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+34:18842:x1875759205621248:12345-192.168.204.35@tcp:36:bash.0 00010000:00010000:1.0:1788864078.237438:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af4a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.237463:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af4a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.237477:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af4a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788864078.237542:0:22630:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1788864078.237569:0:22630:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f289e604 reply state 0000000001ceae2d transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af4a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.237585:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af4a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.237595:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788864078.237598:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788864078.237614:0:22630:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788864078.238245:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+37:18842:x1875759205621248:12345-192.168.204.35@tcp:36:bash.0 Request processed in 1176us (1396us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1788864078.238256:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 51 00000020:00080000:1.0:1788864078.238264:0:22630:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788864078.247866:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.249778:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205621376 00000100:00100000:0.0:1788864078.249798:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205621376 00000100:00100000:0.0:1788864078.249952:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:0.0:1788864078.249967:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+37:18842:x1875759205621376:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788864078.250003:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864078.250034:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6af51 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885e9 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.250164:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6af51 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885e9 expref: 38 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.250223:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6af51 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885e9 expref: 38 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.250260:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788864078.250264:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864078.250268:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542be0e00, rc 0) 00000100:00100000:0.0:1788864078.250373:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+38:18842:x1875759205621376:12345-192.168.204.35@tcp:101:bash.0 Request processed in 410us (2523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864078.250382:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 52 00000100:00100000:0.0:1788864078.256501:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864078.256680:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205621504 00000100:00100000:1.0:1788864078.256694:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205621504 00000100:00100000:1.0:1788864078.256776:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:1.0:1788864078.256788:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+38:18842:x1875759205621504:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:1.0:1788864078.256817:0:25421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864078.256847:0:25421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6af58 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885f0 expref: -99 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.257019:0:25421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af5f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.257039:0:25421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885e2 expref: 39 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.257063:0:25421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af5f lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.258060:0:25421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885e2 expref: 39 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.258121:0:25421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885e2 expref: 39 pid: 25421 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864078.258151:0:25421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25421:1875759226709120:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788864078.258324:0:25421:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e541f0a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864078.264446:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.264615:0:25657:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205621632 00000100:00100000:0.0:1788864078.264628:0:25657:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205621632 00010000:00010000:0.0:1788864078.264681:0:25657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885e2 expref: 40 pid: 25421 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864078.264732:0:25657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 19 00000100:00100000:0.0:1788864078.264744:0:25657:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54418d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+40:2409:x1875759205621632:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864078.264764:0:25657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864078.264772:0:25657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885e2 expref: 40 pid: 25421 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.264786:0:25657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885e2 expref: 40 pid: 25421 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.264814:0:25657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788864078.264839:0:25657:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af5f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.264851:0:25657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af5f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.264860:0:25657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af5f lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.264883:0:25657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864078.264958:0:25657:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54418d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+40:2409:x1875759205621632:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 215us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864078.264966:0:25657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 19 00010000:00010000:1.0:1788864078.266379:0:25421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1a00/0xf569beb9d4b6af3c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885e2 expref: 39 pid: 25421 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864078.266478:0:25421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25421:1875759226709120:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788864078.266510:0:25421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af5f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.266522:0:25421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af5f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.266529:0:25421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af5f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788864078.266671:0:25421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788864078.266677:0:25421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788864078.266710:0:25421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af5f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.266779:0:25421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e400/0xf569beb9d4b6af58 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885f0 expref: 39 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.266799:0:25421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af5f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885f0 expref: 38 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.266811:0:25421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788864078.266814:0:25421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788864078.266817:0:25421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3fa00, rc 0) 00000100:00100000:1.0:1788864078.266946:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+38:18842:x1875759205621504:12345-192.168.204.35@tcp:101:bash.0 Request processed in 10159us (10459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864078.266957:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 53 00000100:00100000:2.0:1788864078.271571:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864078.271778:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205621888 00000100:00100000:3.0:1788864078.271793:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205621888 00000100:00100000:3.0:1788864078.271879:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:3.0:1788864078.271892:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+38:18842:x1875759205621888:12345-192.168.204.35@tcp:103:bash.0 00010000:00010000:3.0:1788864078.271912:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788864078.271948:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6af51 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885e9 expref: 38 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.272013:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fa00/0xf569beb9d4b6af5f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885f0 expref: 37 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.272027:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788864078.272033:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864078.272288:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+36:18842:x1875759205621888:12345-192.168.204.35@tcp:103:bash.0 Request processed in 397us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864078.272297:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 3 00000100:00100000:2.0:1788864078.275534:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864078.275632:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205622016 00000100:00100000:1.0:1788864078.275645:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205622016 00000100:00100000:1.0:1788864078.275719:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:1.0:1788864078.275730:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67af57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+36:18842:x1875759205622016:12345-192.168.204.35@tcp:58:bash.0 00010000:00010000:1.0:1788864078.275885:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af66 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.275909:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af66 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.275923:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af66 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788864078.277958:0:22630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788864078.278012:0:22630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1788864078.278312:0:22630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1788864078.278781:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67af57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+36:18842:x1875759205622016:12345-192.168.204.35@tcp:58:bash.0 Request processed in 3044us (3252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864078.278795:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 54 00000100:00100000:1.0:1788864078.281573:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.281750:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205622144 00000100:00100000:0.0:1788864078.281765:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205622144 00000100:00100000:0.0:1788864078.281883:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 55 00000100:00100000:0.0:1788864078.281896:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+36:18842:x1875759205622144:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788864078.281925:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864078.281953:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0800/0xf569beb9d4b6af6d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885f7 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.282031:0:22628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af66 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.282043:0:22628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0800/0xf569beb9d4b6af6d lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885f7 expref: 37 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.282118:0:22628:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af66 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.282157:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0800/0xf569beb9d4b6af6d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885f7 expref: 37 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.282176:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788864078.282189:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864078.282194:0:22628:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0800/0xf569beb9d4b6af6d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885f7 expref: 37 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.282202:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542be0800, rc 0) 00000100:00100000:0.0:1788864078.282278:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+37:18842:x1875759205622144:12345-192.168.204.35@tcp:101:bash.0 Request processed in 385us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864078.282285:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 55 00000100:00100000:0.0:1788864078.315619:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226709248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788864078.315718:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864078.316031:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226709248 00000100:00100000:3.0:1788864078.316043:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226709248 00000100:00100000:3.0:1788864078.316167:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788864078.316194:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226709248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788864078.316227:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00080000:2.0:1788864078.316352:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788864078.316552:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226709248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 374us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864078.316562:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788864078.316646:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e542a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226709248:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788864078.379620:0:22662:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788864078.379634:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788864078.379668:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788864078.379681:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788864078.379871:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22662:1875759226709376:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788864078.380017:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e676c0b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864078.384684:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22662:1875759226709376:192.168.204.35@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788864078.398524:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.399034:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205622272 00000100:00100000:0.0:1788864078.399049:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205622272 00000100:00100000:0.0:1788864078.399168:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 56 00000100:00100000:0.0:1788864078.399191:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+37:18844:x1875759205622272:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788864078.399236:0:25421:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788864078.399403:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+37:18844:x1875759205622272:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 224us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864078.399412:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 56 00000100:00100000:1.0:1788864078.404883:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864078.405012:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205622400 00000100:00100000:2.0:1788864078.405025:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205622400 00000100:00100000:2.0:1788864078.408564:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 57 00000100:00100000:2.0:1788864078.408594:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+37:18844:x1875759205622400:12345-192.168.204.35@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788864078.408698:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6af74 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.408720:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6af74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.408735:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6af74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411234:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6af7b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411276:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6af7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411289:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6af7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411325:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6af82 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411334:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6af82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411341:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6af82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864078.411397:0:22630:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788864078.411402:0:22630:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788864078.411416:0:22630:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6af82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411428:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6af74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411434:0:22630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6af74 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411440:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6af74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411445:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f0200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788864078.411449:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6af74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411463:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6af74 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411476:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:2.0:1788864078.411479:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864078.411484:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6af74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411490:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6af74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411504:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6af7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411509:0:22630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6af7b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411515:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6af7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411520:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f1200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788864078.411522:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6af7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411528:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6af7b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411534:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff89e54382fe00) 00010000:00010000:2.0:1788864078.411537:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864078.411539:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6af7b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411554:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6af7b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411569:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6af82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411575:0:22630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6af82 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411580:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6af82 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411585:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f0800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:2.0:1788864078.411588:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6af82 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411594:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6af82 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411602:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:2.0:1788864078.411604:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788864078.411607:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6af82 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.411613:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6af82 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864078.411914:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+37:18844:x1875759205622400:12345-192.168.204.35@tcp:34:lhsmtool_posix.0 Request processed in 3331us (7040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864078.411925:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 57 00000100:00100000:3.0:1788864078.424408:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.425271:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205622656 00000100:00100000:0.0:1788864078.425295:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205622656 00000100:00100000:0.0:1788864078.425372:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:0.0:1788864078.425382:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+37:18844:x1875759205622656:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864078.425405:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864078.425425:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6af89 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d251885fe expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.425772:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6af90 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.425790:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6af90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.425803:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6af90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864078.425826:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788864078.425906:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6af90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.427208:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6af90 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.427221:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6af90 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.427227:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be0600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864078.427232:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6af90 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.427240:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6af90 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.427269:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788864078.427272:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788864078.427277:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6af90 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.427283:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6af90 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.427344:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6af89 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885fe expref: 39 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.427355:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e6625ebf00) 00010000:00010000:0.0:1788864078.427357:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788864078.427362:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6af89 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885fe expref: 39 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.427372:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542be0e00, rc 0) 00000100:00100000:0.0:1788864078.427452:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+38:18844:x1875759205622656:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 2071us (3052us total) trans 12884901915 rc 301/301 00000100:00100000:0.0:1788864078.427461:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 58 00000100:00100000:1.0:1788864078.438995:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.443673:0:25422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205622784 00000100:00100000:0.0:1788864078.443691:0:25422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205622784 00000100:00100000:0.0:1788864078.443866:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 59 00000100:00100000:0.0:1788864078.443877:0:25422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+38:18844:x1875759205622784:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788864078.443918:0:25422:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788864078.444063:0:25422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+38:18844:x1875759205622784:12345-192.168.204.35@tcp:53:lhsmtool_posix.0 Request processed in 187us (5146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864078.444108:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 59 00000100:00100000:1.0:1788864078.447981:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864078.448340:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205623040 00000100:00100000:2.0:1788864078.448351:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205623040 00000100:00100000:2.0:1788864078.448414:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:2.0:1788864078.448425:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+38:18844:x1875759205623040:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788864078.448447:0:22630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864078.448470:0:22630:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6af9e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188605 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788864078.448868:0:22630:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =60 00000004:00080000:2.0:1788864078.448875:0:22630:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+60 in llog 00000004:00080000:2.0:1788864078.448898:0:22630:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1788864078.449043:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6afa5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.449058:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6afa5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.449129:0:22630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6afa5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.449990:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0800/0xf569beb9d4b6af9e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188605 expref: 41 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.450017:0:22630:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6afa5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188605 expref: 40 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.450027:0:22630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89e54382fe00) 00010000:00010000:2.0:1788864078.450030:0:22630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788864078.450034:0:22630:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f1200, rc 0) 00000100:00100000:2.0:1788864078.450191:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+40:18844:x1875759205623040:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 1767us (2223us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788864078.450206:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 60 00000100:00100000:3.0:1788864078.458426:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.458825:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205623296 00000100:00100000:0.0:1788864078.458836:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205623296 00000100:00100000:0.0:1788864078.458922:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:0.0:1788864078.458932:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+40:18844:x1875759205623296:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788864078.458995:0:22628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864078.459026:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1200/0xf569beb9d4b6afa5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188605 expref: 40 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459047:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89e54382fe00) 00010000:00010000:0.0:1788864078.459056:0:22628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788864078.459136:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6afb3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459151:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6afb3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459162:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6afb3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459188:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afba lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb4f2cb09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459269:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb4f2cb09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459278:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb4f2cb09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459349:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6afb3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459357:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6afb3 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459364:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6afb3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459370:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be0e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864078.459373:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6afb3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459380:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6afb3 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459389:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:0.0:1788864078.459391:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864078.459395:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6afb3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459401:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6afb3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459411:0:22628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb4f2cb09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459417:0:22628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afba lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb4f2cb09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459423:0:22628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afba lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb4f2cb09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459434:0:22628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be0600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864078.459437:0:22628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afba lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb4f2cb09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459443:0:22628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afba lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb4f2cb09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459450:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb4f2cb09 (ffff89e6625eb200) 00010000:00010000:0.0:1788864078.459453:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864078.459455:0:22628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afba lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb4f2cb09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.459461:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afba lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb4f2cb09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864078.459571:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+39:18844:x1875759205623296:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 639us (1165us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788864078.459579:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 61 00000100:00100000:1.0:1788864078.462371:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.464564:0:25422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205623424 00000100:00100000:0.0:1788864078.464579:0:25422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205623424 00000100:00100000:0.0:1788864078.464959:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:0.0:1788864078.464971:0:25422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+39:18844:x1875759205623424:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864078.464995:0:25422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864078.465019:0:25422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6afc1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518860c expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.465054:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1600/0xf569beb9d4b6afc8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.465120:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1600/0xf569beb9d4b6afc8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.465132:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1600/0xf569beb9d4b6afc8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.465422:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6afc1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518860c expref: 41 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.465443:0:25422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1600/0xf569beb9d4b6afc8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518860c expref: 40 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.465451:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89e6625eb700) 00010000:00010000:0.0:1788864078.465454:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788864078.465457:0:25422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542be1600, rc 0) 00000100:00100000:0.0:1788864078.465534:0:25422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+40:18844:x1875759205623424:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 565us (3171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864078.465542:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 62 00000100:00100000:3.0:1788864078.468279:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864078.472335:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205623680 00000100:00100000:1.0:1788864078.472353:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205623680 00000100:00100000:1.0:1788864078.472454:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:1.0:1788864078.472466:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+40:18844:x1875759205623680:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788864078.472556:0:25421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6afcf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.472576:0:25421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6afcf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.472589:0:25421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6afcf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788864078.472803:0:25421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1788864078.472813:0:25421:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745596736580ns, next at 746596734232ns, rc = 0 00000004:00010000:1.0:1788864078.472864:0:25421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078611cf5 reply state 00000000bf28ee29 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6afcf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.472877:0:25421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6afcf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.472897:0:25421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89e6625eb700) 00010000:00010000:1.0:1788864078.472900:0:25421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788864078.472904:0:25421:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788864078.473036:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+42:18844:x1875759205623680:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 572us (4769us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1788864078.473044:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 63 00000100:00100000:1.0:1788864078.476661:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864078.476720:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205623808 00000100:00100000:3.0:1788864078.476731:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205623808 00000100:00100000:3.0:1788864078.476792:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:3.0:1788864078.476803:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+42:18844:x1875759205623808:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788864078.477728:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788864078.477754:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99200/0xf569beb9d4b6afd6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188613 expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.478374:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99200/0xf569beb9d4b6afd6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188613 expref: 43 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.478393:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99200/0xf569beb9d4b6afd6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188613 expref: 43 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.478412:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89e6625eb700) 00010000:00010000:3.0:1788864078.478415:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788864078.478419:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e681d99200, rc 0) 00000100:00100000:3.0:1788864078.478497:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+43:18844:x1875759205623808:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 1696us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864078.478506:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 64 00000100:00100000:1.0:1788864078.489060:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864078.489412:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205623936 00000100:00100000:2.0:1788864078.489422:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205623936 00000100:00100000:2.0:1788864078.489552:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:2.0:1788864078.489563:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e54420bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2409:x1875759205623936:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788864078.489844:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e54420bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:2409:x1875759205623936:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 Request processed in 276us (785us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788864078.489852:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:1.0:1788864078.493828:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00080000:0.0:1788864078.494089:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788864078.494632:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205624192 00000100:00100000:3.0:1788864078.494644:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205624192 00000100:00100000:3.0:1788864078.494714:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:3.0:1788864078.494725:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+43:18844:x1875759205624192:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788864078.495137:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+44:18844:x1875759205624192:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 412us (1328us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1788864078.495145:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 11 00000100:00100000:3.0:1788864078.501508:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864078.501628:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205624448 00000100:00100000:2.0:1788864078.501638:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205624448 00000100:00100000:2.0:1788864078.501699:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 65 00000100:00100000:2.0:1788864078.501708:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+44:18844:x1875759205624448:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788864078.501878:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+44:18844:x1875759205624448:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 170us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864078.501885:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 65 00010000:00010000:2.0:1788864078.508517:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864078.514443:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.514555:0:25421:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205624576 00000100:00100000:0.0:1788864078.514566:0:25421:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205624576 00000100:00100000:0.0:1788864078.514640:0:25421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:0.0:1788864078.514651:0:25421:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e544208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+44:18844:x1875759205624576:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788864078.514672:0:25421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864078.514693:0:25421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6afdd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518861a expref: -99 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.514808:0:25421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afe4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.514824:0:25421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afe4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.514837:0:25421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afe4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788864078.514883:0:25421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788864078.514902:0:25421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afe4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.514943:0:25421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6afdd lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518861a expref: 46 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.514964:0:25421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afe4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518861a expref: 45 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.514972:0:25421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89e6625eb700) 00010000:00010000:0.0:1788864078.514975:0:25421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788864078.514978:0:25421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542be0600, rc 0) 00000100:00100000:0.0:1788864078.515049:0:25421:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e544208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+45:18844:x1875759205624576:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 400us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864078.515057:0:25421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 66 00000100:00100000:1.0:1788864078.532623:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864078.532730:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205624704 00000100:00100000:2.0:1788864078.532740:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205624704 00000100:00100000:2.0:1788864078.532814:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:2.0:1788864078.532827:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+6:2408:x1875759205624704:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788864078.532847:0:24138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864078.532868:0:24138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000029ca66a/0xf569beb9d4b6afeb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188621 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788864078.532924:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fe64e, blocks: 0x0 00010000:00010000:2.0:1788864078.532948:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=745s v=(0 0) 00010000:00010000:2.0:1788864078.532953:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864078.532963:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000029ca66a/0xf569beb9d4b6afeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188621 expref: 7 pid: 24138 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.532983:0:24138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000029ca66a/0xf569beb9d4b6afeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188621 expref: 7 pid: 24138 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.532995:0:24138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f0800, rc 0) 00000100:00100000:2.0:1788864078.533056:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:2408:x1875759205624704:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 231us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864078.533063:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:1.0:1788864078.551498:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864078.551608:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205624960 00000100:00100000:2.0:1788864078.551618:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205624960 00000100:00100000:2.0:1788864078.551687:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:2.0:1788864078.551697:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+45:18844:x1875759205624960:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788864078.551820:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+45:18844:x1875759205624960:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 124us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864078.551828:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:1.0:1788864078.562284:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.567873:0:25422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205625088 00000100:00100000:0.0:1788864078.567895:0:25422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205625088 00000100:00100000:0.0:1788864078.568803:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:0.0:1788864078.568837:0:25422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+45:18844:x1875759205625088:12345-192.168.204.35@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788864078.586244:0:22608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:1.0:1788864078.586265:0:22608:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788864078.586516:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6adad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586545:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6adad lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586572:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6adad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586580:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788864078.586585:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6adad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586594:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6adad lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586612:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff89e675672400) 00010000:00010000:3.0:1788864078.586615:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864078.586620:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6adad lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586627:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99e00/0xf569beb9d4b6adad lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586648:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6adb4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586655:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6adb4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586660:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6adb4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586664:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f0400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788864078.586667:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6adb4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586684:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6adb4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586693:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:3.0:1788864078.586696:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864078.586699:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6adb4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586705:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0400/0xf569beb9d4b6adb4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586721:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6ae5c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586727:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6ae5c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586733:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6ae5c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586738:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ee00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788864078.586741:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6ae5c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586747:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6ae5c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586755:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff89e643aa2d00) 00010000:00010000:3.0:1788864078.586757:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864078.586760:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6ae5c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586771:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ee00/0xf569beb9d4b6ae5c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586789:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aee1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586794:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aee1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586800:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aee1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586804:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3fe00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788864078.586807:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aee1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586813:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aee1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586822:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788864078.586824:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864078.586828:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aee1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586834:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3fe00/0xf569beb9d4b6aee1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586844:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6af04 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586851:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6af04 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586862:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6af04 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586867:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788864078.586870:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6af04 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586876:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6af04 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586884:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788864078.586887:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864078.586890:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6af04 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586896:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e800/0xf569beb9d4b6af04 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586909:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af4a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586915:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af4a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586920:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af4a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586925:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3ea00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788864078.586928:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af4a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586944:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af4a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586959:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:3.0:1788864078.586962:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788864078.586964:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af4a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586970:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3ea00/0xf569beb9d4b6af4a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586985:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6afcf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586991:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6afcf lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.586997:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6afcf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.587003:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3e600 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:3.0:1788864078.587006:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6afcf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864078.587022:0:25422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+38:18844:x1875759205625088:12345-192.168.204.35@tcp:44:lhsmtool_posix.0 Request processed in 18170us (24737us total) trans 0 rc 0/0 00010000:00010000:3.0:1788864078.587023:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6afcf lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.587054:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89e6625eb700) 00000100:00100000:0.0:1788864078.587058:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 68 00010000:00010000:3.0:1788864078.587065:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788864078.587071:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6afcf lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.587149:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e600/0xf569beb9d4b6afcf lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864078.591448:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226709504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788864078.591523:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864078.592003:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864078.592192:0:24137:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226709504 00000100:00100000:3.0:1788864078.592202:0:24137:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226709504 00000100:00100000:3.0:1788864078.592257:0:24137:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205625216 00000100:00100000:3.0:1788864078.592261:0:24137:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205625216 00000100:00100000:3.0:1788864078.592283:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788864078.592294:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875759226709504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788864078.592537:0:24137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788864078.592542:0:24137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788864078.592544:0:24137:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788864078.592546:0:24137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788864078 -> 1788864078 00002000:00010000:3.0:1788864078.592548:0:24137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788864078.592611:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875759226709504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 318us (1087us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788864078.592618:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788864078.592638:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:3.0:1788864078.592646:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:2408:x1875759205625216:12345-192.168.204.35@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788864078.592710:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:2408:x1875759205625216:12345-192.168.204.35@tcp:16:lhsmtool_posix.0 Request processed in 66us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864078.592717:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 28 00000004:00080000:3.0:1788864078.592757:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e67af54e00/2, rc 0, transno 12884901892 00000100:00100000:3.0:1788864078.592764:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67af54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875759226709504:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788864078.596451:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788864078.597262:0:22608:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1788864078.597540:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ae01 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.597555:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ae01 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.597563:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ae01 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.597570:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f1c00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864078.597575:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ae01 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.597582:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ae01 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.597796:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:0.0:1788864078.597800:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788864078.597805:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ae01 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.597812:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1c00/0xf569beb9d4b6ae01 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864078.602562:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864078.602665:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205625472 00000100:00100000:3.0:1788864078.602676:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205625472 00000100:00100000:3.0:1788864078.602739:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:3.0:1788864078.602750:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+14:18844:x1875759205625472:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788864078.602809:0:22628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864078.602836:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0600/0xf569beb9d4b6afe4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518861a expref: 14 pid: 25421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.602858:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89e6625eb700) 00010000:00010000:3.0:1788864078.602864:0:22628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788864078.602897:0:22628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98400/0xf569beb9d4b6aff2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.602912:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98400/0xf569beb9d4b6aff2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.602922:0:22628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98400/0xf569beb9d4b6aff2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788864078.603048:0:22628:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b0fc87c reply state 00000000360ba3f3 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98400/0xf569beb9d4b6aff2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.603072:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98400/0xf569beb9d4b6aff2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.603327:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89e6625eb700) 00010000:00010000:3.0:1788864078.603330:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788864078.603333:0:22628:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788864078.607198:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+15:18844:x1875759205625472:12345-192.168.204.35@tcp:36:lhsmtool_posix.0 Request processed in 4438us (4633us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1788864078.607211:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:3.0:1788864078.609535:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864078.609708:0:24137:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205625600 00000100:00100000:1.0:1788864078.609717:0:24137:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205625600 00000100:00100000:1.0:1788864078.609778:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:1.0:1788864078.609788:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:18844:x1875759205625600:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788864078.609808:0:24137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788864078.609827:0:24137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b6aff9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188628 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.609862:0:24137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000029ca66a/0xf569beb9d4b6afeb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188621 expref: 8 pid: 24138 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.609891:0:24137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864078.609896:0:24137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788864078.609901:0:24137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b6aff9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188628 expref: 8 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.609938:0:24137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000029ca66a/0xf569beb9d4b6afeb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188621 expref: 8 pid: 24138 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.609952:0:24137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000029ca66a/0xf569beb9d4b6afeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188621 expref: 8 pid: 24138 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864078.609967:0:24137:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24137:1875759226709632:192.168.204.35@tcp:104: 00000100:00100000:1.0:1788864078.610068:0:24137:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e5425776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788864078.616197:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864078.616300:0:25657:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205625728 00000100:00100000:2.0:1788864078.616323:0:25657:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205625728 00010000:00010000:2.0:1788864078.616375:0:25657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000029ca66a/0xf569beb9d4b6afeb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188621 expref: 9 pid: 24138 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864078.616421:0:25657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:2.0:1788864078.616431:0:25657:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+9:2408:x1875759205625728:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788864078.616447:0:25657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788864078.616468:0:25657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000029ca66a/0xf569beb9d4b6afeb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188621 expref: 9 pid: 24138 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.616483:0:25657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000029ca66a/0xf569beb9d4b6afeb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188621 expref: 9 pid: 24138 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.616509:0:25657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864078.616514:0:25657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788864078.616522:0:25657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b6aff9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188628 expref: 9 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.616532:0:25657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b6aff9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188628 expref: 9 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.616593:0:25657:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b6aff9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188628 expref: 9 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864078.616621:0:25657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67e2e8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:25657:1875759226709760:192.168.204.35@tcp:105: 00000100:00100000:2.0:1788864078.616711:0:25657:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647dcc840 going to sleep for 11 seconds 00010000:00010000:1.0:1788864078.617144:0:24137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000029ca66a/0xf569beb9d4b6afeb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188621 expref: 9 pid: 24138 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864078.617161:0:24137:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24137:1875759226709632:192.168.204.35@tcp:104: 00010000:00010000:1.0:1788864078.617195:0:24137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b6aff9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188628 expref: 8 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.617208:0:24137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542a3e400, rc 0) 00000100:00100000:1.0:1788864078.617258:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+8:18844:x1875759205625600:12345-192.168.204.35@tcp:101:lhsmtool_posix.0 Request processed in 7470us (7745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864078.617277:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 29 00000100:00100000:2.0:1788864078.637772:0:25657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67e2e8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:25657:1875759226709760:192.168.204.35@tcp:105: 00010000:00010000:2.0:1788864078.637805:0:25657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788864078.637889:0:25657:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:2408:x1875759205625728:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 21458us (21702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864078.637901:0:25657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 20 00000100:00100000:0.0:1788864078.640856:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864078.640966:0:24435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205625856 00000100:00100000:2.0:1788864078.640976:0:24435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205625856 00000100:00100000:2.0:1788864078.641038:0:24435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:2.0:1788864078.641049:0:24435:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:2409:x1875759205625856:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788864078.641485:0:24435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788864078.641489:0:24435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788864078 00002000:00010000:2.0:1788864078.641492:0:24435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788864076 00002000:00010000:2.0:1788864078.641494:0:24435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788864078 -> 1788864078 00002000:00010000:2.0:1788864078.641496:0:24435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788864078.642458:0:24435:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+8:2409:x1875759205625856:12345-192.168.204.35@tcp:2:lhsmtool_posix.0 Request processed in 1404us (1605us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788864078.642470:0:24435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 30 00000100:00100000:0.0:1788864078.650910:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864078.651220:0:24136:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205625984 00000100:00100000:3.0:1788864078.651246:0:24136:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205625984 00000100:00100000:3.0:1788864078.651433:0:24136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:3.0:1788864078.651445:0:24136:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+8:2408:x1875759205625984:12345-192.168.204.35@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788864078.651496:0:24136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.651520:0:24136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b6aff9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188628 expref: 8 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.651529:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788864078.651534:0:24136:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788864078.651539:0:24136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.651580:0:24136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b6aff9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188628 expref: 8 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.651594:0:24136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b6aff9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188628 expref: 8 pid: 24137 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864078.651609:0:24136:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24136:1875759226709888:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788864078.651701:0:24136:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b622c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788864078.654580:0:24136:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24136:1875759226709888:192.168.204.35@tcp:104: 00010000:00010000:3.0:1788864078.654623:0:24136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864078.655545:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864078.655797:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205626112 00000100:00100000:3.0:1788864078.655806:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205626112 00010000:00010000:3.0:1788864078.655848:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b6aff9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188628 expref: 9 pid: 24137 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864078.655900:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:3.0:1788864078.655911:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+9:2409:x1875759205626112:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864078.655926:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864078.655950:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b6aff9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188628 expref: 9 pid: 24137 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.655963:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b6aff9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188628 expref: 9 pid: 24137 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.655989:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db9097b9/0xf569beb9d4b6aff9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188628 expref: 9 pid: 24137 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.656005:0:22614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788864078.656009:0:22614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788864078.656015:0:22614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.656025:0:22614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.656140:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864078.656212:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+8:2409:x1875759205626112:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 303us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864078.656220:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00010000:00010000:0.0:1788864078.658512:0:24136:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.658532:0:24136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.658563:0:24136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.658572:0:24136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.658581:0:24136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.658588:0:24136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d99e00 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:0.0:1788864078.658594:0:24136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.658603:0:24136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.658622:0:24136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.658649:0:24136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e47e431a/0xf569beb9d4b6b000 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864078.658767:0:24136:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:2408:x1875759205625984:12345-192.168.204.35@tcp:1:lhsmtool_posix.0 Request processed in 7319us (7866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864078.658777:0:24136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 31 00000100:00100000:3.0:1788864078.664246:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864078.664467:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205626368 00000100:00100000:2.0:1788864078.664480:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205626368 00000100:00100000:2.0:1788864078.664551:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:2.0:1788864078.664561:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+15:18844:x1875759205626368:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788864078.664687:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.664705:0:22629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b6aeda lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885c6 expref: 15 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.664729:0:22629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.664765:0:22629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b6aeda lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885c6 expref: 15 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.664778:0:22629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b6aeda lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885c6 expref: 15 pid: 25422 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788864078.664793:0:22629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67e2e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22629:1875759226710016:192.168.204.35@tcp:104: 00000100:00100000:2.0:1788864078.664882:0:22629:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e647dcc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788864078.673015:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864078.673168:0:22629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67e2e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22629:1875759226710016:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788864078.673213:0:22629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864078.673307:0:22613:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205626496 00000100:00100000:0.0:1788864078.673316:0:22613:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205626496 00010000:00010000:0.0:1788864078.673368:0:22613:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b6aeda lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885c6 expref: 16 pid: 25422 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864078.673410:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 22 00000100:00100000:0.0:1788864078.673420:0:22613:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+16:2408:x1875759205626496:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788864078.673439:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788864078.673446:0:22613:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b6aeda lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885c6 expref: 16 pid: 25422 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.673458:0:22613:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b6aeda lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885c6 expref: 16 pid: 25422 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.673481:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3e000/0xf569beb9d4b6aeda lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885c6 expref: 16 pid: 25422 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.673497:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788864078.673504:0:22613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0800/0xf569beb9d4b6af6d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885f7 expref: 15 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.673530:0:22613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.673539:0:22613:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.673548:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.673584:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788864078.673640:0:22613:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+15:2408:x1875759205626496:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 220us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864078.673648:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 22 00010000:00010000:3.0:1788864078.674587:0:22629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.674610:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.674831:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.674847:0:22629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99200/0xf569beb9d4b6afd6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188613 expref: 15 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.674855:0:22629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.674888:0:22629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99200/0xf569beb9d4b6afd6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188613 expref: 15 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.674901:0:22629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99200/0xf569beb9d4b6afd6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188613 expref: 15 pid: 22628 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864078.674915:0:22629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22629:1875759226710144:192.168.204.35@tcp:104: 00000100:00100000:3.0:1788864078.675019:0:22629:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e67b6220c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788864078.680317:0:22629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22629:1875759226710144:192.168.204.35@tcp:104: 00010000:00010000:2.0:1788864078.680361:0:22629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788864078.683049:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864078.683930:0:22614:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205626624 00000100:00100000:3.0:1788864078.683942:0:22614:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205626624 00010000:00010000:3.0:1788864078.684030:0:22614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99200/0xf569beb9d4b6afd6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188613 expref: 16 pid: 22628 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788864078.684219:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 23 00000100:00100000:3.0:1788864078.684230:0:22614:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e643882c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+16:2409:x1875759205626624:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788864078.684245:0:22614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788864078.684253:0:22614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99200/0xf569beb9d4b6afd6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188613 expref: 16 pid: 22628 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.684266:0:22614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99200/0xf569beb9d4b6afd6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188613 expref: 16 pid: 22628 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.684291:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d99200/0xf569beb9d4b6afd6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188613 expref: 16 pid: 22628 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.684307:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89e6625eb700) 00010000:00010000:3.0:1788864078.684313:0:22614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.684323:0:22614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.684331:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.684429:0:22614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788864078.684511:0:22614:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e643882c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+15:2409:x1875759205626624:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 283us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864078.684520:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 23 00010000:00010000:0.0:1788864078.684636:0:22629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.684646:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788864078.684762:0:22629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:0.0:1788864078.684890:0:22629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:0.0:1788864078.684927:0:22629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:0.0:1788864078.685027:0:22629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22629:1875759226710272:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788864078.686181:0:22629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864078.686213:0:22629:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e6583be540 going to sleep for 11 seconds 00000100:00100000:1.0:1788864078.686813:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226710272 00000100:00100000:1.0:1788864078.686822:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226710272 00000100:00100000:1.0:1788864078.686880:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788864078.686890:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22629:x1875759226710272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788864078.687007:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22629:x1875759226710272:12345-0@lo:1000:mdt00_001.0 Request processed in 119us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864078.687015:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788864078.687541:0:22629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22629:1875759226710272:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788864078.687729:0:22629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:0.0:1788864078.687803:0:22629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22629:1875759226710400:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788864078.687859:0:22629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864078.687879:0:22629:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c148f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788864078.688040:0:22633:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226710400 00000100:00100000:1.0:1788864078.688046:0:22633:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226710400 00000100:00100000:1.0:1788864078.688245:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788864078.688254:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22629:x1875759226710400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788864078.688515:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22629:x1875759226710400:12345-0@lo:1000:mdt00_001.0 Request processed in 263us (656us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788864078.688523:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788864078.688601:0:22629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22629:1875759226710400:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788864078.688643:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688653:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688661:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688667:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e681d98000 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864078.688672:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688680:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688696:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89e6625eb700) 00010000:00010000:0.0:1788864078.688699:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864078.688703:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688709:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e681d98000/0xf569beb9d4b6b00e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688739:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af66 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688746:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af66 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688764:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af66 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688769:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864078.688772:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af66 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688778:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af66 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688787:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788864078.688789:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788864078.688795:0:22629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0800/0xf569beb9d4b6af6d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885f7 expref: 18 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688806:0:22629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0800/0xf569beb9d4b6af6d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885f7 expref: 18 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688815:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0800/0xf569beb9d4b6af6d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885f7 expref: 18 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.688866:0:22629:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0800/0xf569beb9d4b6af6d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d251885f7 expref: 18 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864078.688879:0:22629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b79880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22629:1875759226710528:192.168.204.35@tcp:105: 00000100:00100000:0.0:1788864078.688960:0:22629:0:(client.c:2716:ptlrpc_set_wait()) set ffff89e66c148300 going to sleep for 11 seconds 00000100:00100000:2.0:1788864078.693740:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1788864078.693803:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205626752 00000100:00100000:3.0:1788864078.693812:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205626752 00000100:00100000:3.0:1788864078.693871:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:3.0:1788864078.693880:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+19:18842:x1875759205626752:12345-192.168.204.35@tcp:49:bash.0 00000100:00100000:3.0:1788864078.694021:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+19:18842:x1875759205626752:12345-192.168.204.35@tcp:49:bash.0 Request processed in 142us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864078.694029:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 12 00000100:00100000:0.0:1788864078.696911:0:22629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b79880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22629:1875759226710528:192.168.204.35@tcp:105: 00010000:00010000:0.0:1788864078.696966:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af66 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.696977:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f800/0xf569beb9d4b6af66 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22630 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697025:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6b015 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697039:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6b015 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697050:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6b015 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697072:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6b015 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697101:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6b015 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697107:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6b015 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697113:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be0400 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864078.697116:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6b015 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697123:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6b015 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697134:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788864078.697144:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864078.697149:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6b015 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697155:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6b015 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697167:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697184:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697191:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697195:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e5410f0200 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864078.697198:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697205:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697213:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788864078.697215:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788864078.697218:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.697223:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f0200/0xf569beb9d4b6b007 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864078.697424:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+18:18844:x1875759205626368:12345-192.168.204.35@tcp:57:lhsmtool_posix.0 Request processed in 32863us (33186us total) trans 12884901924 rc 0/0 00000100:00100000:0.0:1788864078.697444:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00000020:00080000:0.0:1788864078.697451:0:22629:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788864078.698107:0:22662:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788864078.698116:0:22662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788864078.698134:0:22662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788864078.698139:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788864078.701147:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.701256:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205626880 00000100:00100000:0.0:1788864078.701269:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205626880 00000100:00100000:0.0:1788864078.701344:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 32 00000100:00100000:0.0:1788864078.701356:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+7:18842:x1875759205626880:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788864078.701377:0:24138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864078.701403:0:24138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f51c63b1/0xf569beb9d4b6b01c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518862f expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788864078.701435:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9fe64e, atime: 0x6a9fe64c, ctime: 0x6a9fe64e, blocks: 0x0 00010000:00010000:0.0:1788864078.701462:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=745s v=(0 0) 00010000:00010000:0.0:1788864078.701466:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788864078.701476:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51c63b1/0xf569beb9d4b6b01c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518862f expref: 8 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.701494:0:24138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f51c63b1/0xf569beb9d4b6b01c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518862f expref: 8 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.701506:0:24138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542be1e00, rc 0) 00000100:00100000:0.0:1788864078.701558:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+8:18842:x1875759205626880:12345-192.168.204.35@tcp:101:bash.0 Request processed in 205us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864078.701566:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 32 00000100:00100000:3.0:1788864078.704891:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864078.704998:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205627136 00000100:00100000:1.0:1788864078.705009:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205627136 00000100:00100000:1.0:1788864078.705071:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 13 00000100:00100000:1.0:1788864078.705113:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+18:18844:x1875759205627136:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788864078.705445:0:22632:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788864078.705485:0:22632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:1.0:1788864078.705523:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6b023 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.705542:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6b023 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.705575:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6b023 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.705584:0:22632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6b023 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.705591:0:22632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6b023 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.705597:0:22632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6b023 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.705626:0:22632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788864078.705731:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+20:18844:x1875759205627136:12345-192.168.204.35@tcp:35:lhsmtool_posix.0 Request processed in 620us (849us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1788864078.705740:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 13 00000020:00080000:1.0:1788864078.705746:0:22632:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788864078.705970:0:22616:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788864078.705978:0:22616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6b023 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.705987:0:22616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542a3f200 already unused, calling callback (ffffffffc0e79930) 00010000:00010000:3.0:1788864078.705992:0:22616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6b023 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.706001:0:22616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6b023 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.706015:0:22616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff89e6625eb700) 00010000:00010000:3.0:1788864078.706019:0:22616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788864078.706024:0:22616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6b023 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.706030:0:22616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542a3f200/0xf569beb9d4b6b023 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788864078.706056:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864078.706058:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788864078.706059:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788864078.710711:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.710821:0:25422:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205627264 00000100:00100000:0.0:1788864078.710833:0:25422:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205627264 00000100:00100000:0.0:1788864078.710901:0:25422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:0.0:1788864078.710927:0:25422:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e6808e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+20:18842:x1875759205627264:12345-192.168.204.35@tcp:101:bash.0 00010000:00010000:0.0:1788864078.710953:0:25422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788864078.710980:0:25422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6b02a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d25188636 expref: -99 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.711029:0:25422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1000/0xf569beb9d4b6b031 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.711046:0:25422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1000/0xf569beb9d4b6b031 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.711071:0:25422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1000/0xf569beb9d4b6b031 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.711526:0:25422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0400/0xf569beb9d4b6b02a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188636 expref: 22 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.711547:0:25422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1000/0xf569beb9d4b6b031 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d25188636 expref: 21 pid: 25422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788864078.711556:0:25422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:1.0:1788864078.711559:0:25422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788864078.711563:0:25422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e542be1000, rc 0) 00000100:00100000:1.0:1788864078.711633:0:25422:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e6808e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+21:18842:x1875759205627264:12345-192.168.204.35@tcp:101:bash.0 Request processed in 708us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864078.711647:0:25422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 71 00000100:00100000:2.0:1788864078.717406:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864078.717560:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205627520 00000100:00100000:1.0:1788864078.717570:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205627520 00000100:00100000:1.0:1788864078.717640:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 14 00000100:00100000:1.0:1788864078.717651:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+21:18842:x1875759205627520:12345-192.168.204.35@tcp:35:bash.0 00000001:00080000:1.0:1788864078.717874:0:22632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:1.0:1788864078.717953:0:22632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:1.0:1788864078.718122:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+24:18842:x1875759205627520:12345-192.168.204.35@tcp:35:bash.0 Request processed in 471us (725us total) trans 12884901929 rc 0/0 00000100:00100000:1.0:1788864078.718131:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 14 00000020:00080000:1.0:1788864078.718136:0:22632:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788864078.858209:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864078.858537:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205627776 00000100:00100000:2.0:1788864078.858550:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205627776 00000100:00100000:2.0:1788864078.858617:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:2.0:1788864078.858628:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+24:18854:x1875759205627776:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1788864078.858655:0:22628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788864078.858680:0:22628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1600/0xf569beb9d4b6b038 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b14c97d2518863d expref: -99 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788864078.858797:0:22628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788864078.858905:0:22628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1600/0xf569beb9d4b6b038 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518863d expref: 26 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.858920:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e675672a00) 00010000:00010000:2.0:1788864078.858924:0:22628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788864078.858929:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e5410f1600/0xf569beb9d4b6b038 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6b14c97d2518863d expref: 26 pid: 22628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788864078.858941:0:22628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e5410f1600, rc 0) 00000100:00100000:2.0:1788864078.859020:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+25:18854:x1875759205627776:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 394us (823us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1788864078.859027:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 72 00000100:00100000:2.0:1788864078.881011:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864078.881254:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205627904 00000100:00100000:0.0:1788864078.881266:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205627904 00000100:00100000:0.0:1788864078.881341:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:0.0:1788864078.881352:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+25:18854:x1875759205627904:12345-192.168.204.35@tcp:34:lfs.0 00010000:00010000:0.0:1788864078.881439:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6b046 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.881458:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6b046 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.881486:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6b046 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.881503:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6b04d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.881510:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6b04d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.881533:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6b04d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.881624:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0a00/0xf569beb9d4b6b054 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.881634:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0a00/0xf569beb9d4b6b054 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.881640:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0a00/0xf569beb9d4b6b054 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788864078.881685:0:22629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0a00/0xf569beb9d4b6b054 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.881697:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6b046 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.881703:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6b046 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.881711:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6b046 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.881716:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be0e00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864078.881721:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6b046 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.881998:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6b046 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882011:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff89e54382f500) 00010000:00010000:0.0:1788864078.882021:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864078.882028:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6b046 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882034:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0e00/0xf569beb9d4b6b046 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882049:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6b04d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882065:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6b04d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882071:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6b04d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882131:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be1800 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864078.882135:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6b04d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882141:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6b04d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882150:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff89e6625eb900) 00010000:00010000:0.0:1788864078.882152:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864078.882155:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6b04d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882159:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be1800/0xf569beb9d4b6b04d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882186:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0a00/0xf569beb9d4b6b054 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882200:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0a00/0xf569beb9d4b6b054 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882206:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0a00/0xf569beb9d4b6b054 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882211:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e542be0a00 already unused, calling callback (ffffffffc1a8b4f0) 00010000:00010000:0.0:1788864078.882214:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0a00/0xf569beb9d4b6b054 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882219:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0a00/0xf569beb9d4b6b054 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882227:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff89e643aa2c00) 00010000:00010000:0.0:1788864078.882230:0:22629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788864078.882233:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0a00/0xf569beb9d4b6b054 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788864078.882239:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e542be0a00/0xf569beb9d4b6b054 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788864078.882335:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+25:18854:x1875759205627904:12345-192.168.204.35@tcp:34:lfs.0 Request processed in 981us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864078.882344:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 73 00000100:00100000:0.0:1788864078.888290:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864078.888385:0:22632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205628160 00000100:00100000:1.0:1788864078.888397:0:22632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205628160 00000100:00100000:1.0:1788864078.888465:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 15 00000100:00100000:1.0:1788864078.888476:0:22632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+25:18854:x1875759205628160:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:1.0:1788864078.888721:0:22632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+26:18854:x1875759205628160:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 246us (441us total) trans 12884901931 rc 0/0 00000100:00100000:1.0:1788864078.888737:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 15 00000040:00080000:2.0:1788864079.214970:0:23385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788864079.339310:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e67e2ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226710656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788864079.339416:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864079.339459:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e543b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226710784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788864079.339481:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864079.339540:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226710656 00000100:00100000:0.0:1788864079.339549:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226710656 00000100:00100000:0.0:1788864079.339609:0:24140:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226710784 00000100:00100000:0.0:1788864079.339612:0:24140:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226710784 00000100:00100000:0.0:1788864079.339628:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788864079.339635:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226710656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788864079.339665:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788864079.339705:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875759226710656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864079.339712:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788864079.339740:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788864079.339746:0:24140:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875759226710784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788864079.339754:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788864079.339774:0:24140:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875759226710784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864079.339780:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788864079.339816:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e67e2ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875759226710656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788864079.339829:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e543b78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226710784:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788864079.339851:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788864079.340097:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788864079.340108:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e5440eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226710912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788864079.340145:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864079.340181:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226711040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788864079.340203:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788864079.340231:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226710912 00000100:00100000:3.0:1788864079.340235:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226710912 00000100:00100000:3.0:1788864079.340263:0:23371:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226711040 00000100:00100000:3.0:1788864079.340265:0:23371:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226711040 00000100:00100000:1.0:1788864079.340277:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788864079.340319:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226711424:0@lo:400:kworker.0 00000100:00100000:0.0:1788864079.340323:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226711296:0@lo:400:kworker.0 00000100:00100000:0.0:1788864079.340349:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864079.340351:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864079.340369:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226711936:0@lo:400:kworker.0 00000100:00100000:0.0:1788864079.340369:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226711808:0@lo:400:kworker.0 00000100:00100000:2.0:1788864079.340388:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864079.340404:0:24137:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226711296 00000100:00100000:0.0:1788864079.340407:0:24137:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226711296 00000100:00100000:2.0:1788864079.340419:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788864079.340425:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226711552:0@lo:400:kworker.0 00000100:00100000:0.0:1788864079.340441:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788864079.340447:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864079.340447:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226711296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864079.340463:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226712064:0@lo:400:kworker.0 00000100:00100000:2.0:1788864079.340482:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864079.340508:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226711424 00000100:00100000:2.0:1788864079.340511:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226711424 00000100:00100000:2.0:1788864079.340537:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226711936 00000100:00100000:2.0:1788864079.340540:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226711936 00000100:00100000:2.0:1788864079.340557:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226712064 00000100:00100000:2.0:1788864079.340560:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226712064 00000100:00100000:2.0:1788864079.340573:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788864079.340573:0:22633:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226710912:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788864079.340579:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226711424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864079.340618:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875759226711424:12345-0@lo:400:kworker.0 Request processed in 39us (266us total) trans 0 rc 0/0 00000004:00000024:1.0:1788864079.340618:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788864079.340624:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788864079.340651:0:22633:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875759226710912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 367us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864079.340652:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875759226711424:0@lo:400:kworker.0 00000100:00100000:2.0:1788864079.340671:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788864079.340677:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226711936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864079.340701:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875759226711296:12345-0@lo:400:kworker.0 Request processed in 254us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864079.340702:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875759226711936:12345-0@lo:400:kworker.0 Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864079.340708:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788864079.340708:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788864079.340730:0:24137:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226711552 00010000:00080000:2.0:1788864079.340732:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e6808ea680 x1875759226711936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864079.340733:0:24137:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226711552 00000100:00100000:2.0:1788864079.340743:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875759226711936:0@lo:400:kworker.0 00000100:00100000:0.0:1788864079.340753:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788864079.340758:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226711552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864079.340762:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788864079.340773:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226712064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864079.340796:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875759226711552:12345-0@lo:400:kworker.0 Request processed in 38us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864079.340800:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875759226711552:0@lo:400:kworker.0 00000100:00100000:0.0:1788864079.340802:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788864079.340822:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864079.340826:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875759226712064:12345-0@lo:400:kworker.0 Request processed in 54us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864079.340832:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788864079.340842:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875759226711296:0@lo:400:kworker.0 00000100:00100000:0.0:1788864079.340851:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788864079.340857:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3643:1875759226711168:0@lo:400:kworker.0 00000100:00100000:2.0:1788864079.340867:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875759226712064:0@lo:400:kworker.0 00000100:00100000:2.0:1788864079.340882:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226711808 00000100:00100000:2.0:1788864079.340884:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226711808 00000100:00100000:0.0:1788864079.340884:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864079.340907:0:22623:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226711168 00000100:00100000:2.0:1788864079.340910:0:22623:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226711168 00000100:00100000:0.0:1788864079.340923:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226711680:0@lo:400:kworker.0 00000100:00100000:2.0:1788864079.340931:0:22623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788864079.340936:0:22623:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:3643:x1875759226711168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864079.340943:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788864079.340953:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff89e6808e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226712192:0@lo:400:kworker.0 00000100:00100000:2.0:1788864079.340961:0:22623:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3+24:3643:x1875759226711168:12345-0@lo:400:kworker.0 Request processed in 25us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864079.340967:0:22623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788864079.340975:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788864079.340988:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226711680 00000100:00100000:0.0:1788864079.340989:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:814b6715-5ca6-4ba3-b2fa-53a13bb79fd3:3643:1875759226711168:0@lo:400:kworker.0 00000100:00100000:2.0:1788864079.340991:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226711680 00000100:00100000:2.0:1788864079.341003:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759226712192 00000100:00100000:2.0:1788864079.341005:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759226712192 00000100:00080000:0.0:1788864079.341009:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788864079.341012:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788864079.341015:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788864079.341018:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788864079.341022:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226711808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864079.341025:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788864079.341030:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e543b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226711680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788864079.341059:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875759226711808:12345-0@lo:400:kworker.0 Request processed in 36us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864079.341064:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788864079.341094:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788864079.341096:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875759226711808:0@lo:400:kworker.0 00000100:00100000:2.0:1788864079.341100:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e542ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226712192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788864079.341130:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e543b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875759226711680:12345-0@lo:400:kworker.0 Request processed in 99us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864079.341131:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e542ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875759226712192:12345-0@lo:400:kworker.0 Request processed in 32us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864079.341137:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788864079.341139:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788864079.341171:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875759226711680:0@lo:400:kworker.0 00010000:00080000:0.0:1788864079.341183:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff89e6808e9180 x1875759226712192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788864095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788864079.341192:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875759226712192:0@lo:400:kworker.0 00000100:00100000:0.0:1788864079.341247:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e5440eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875759226710912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788864079.344774:0:23371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788864079.344806:0:23371:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226711040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788864079.344864:0:23371:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788864079.344958:0:23371:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e5440e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875759226711040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (4753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864079.344966:0:23371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788864079.345326:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788864079.349875:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff89e6808eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875759226711040:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788864079.531527:0:22617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788864080.426489:0:25711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1788864080.556347:0:23384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788864081.402246:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864081.402404:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864081.402474:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1788864081.406906:0:24435:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205628672 00000100:00100000:1.0:1788864081.406935:0:24435:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205628672 00000100:00080000:1.0:1788864081.407021:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788864081.407095:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:1.0:1788864081.407108:0:24137:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2411:x1875759205628672:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1788864081.407200:0:24137:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2411:x1875759205628672:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 96us (4797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788864081.407208:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 25 00000100:00100000:2.0:1788864081.410533:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864081.410569:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864081.410596:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1788864081.413353:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205628416 00000100:00100000:0.0:1788864081.413376:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205628416 00000100:00080000:0.0:1788864081.414820:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788864081.414839:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205628928 00000100:00100000:3.0:1788864081.414847:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205628928 00000100:00100000:0.0:1788864081.414849:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00100000:0.0:1788864081.414865:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+26:2411:x1875759205628416:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788864081.414884:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:3.0:1788864081.414892:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:2411:x1875759205628928:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:3.0:1788864081.414974:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+6:2411:x1875759205628928:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 83us (12499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788864081.414981:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 68 00000100:00100000:0.0:1788864081.415229:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+26:2411:x1875759205628416:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 369us (13164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788864081.415237:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 67 00000100:00080000:0.0:1788864081.415260:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788864081.417565:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864081.417593:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864081.417640:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1788864081.417679:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205629184 00000100:00100000:2.0:1788864081.417689:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205629184 00000100:00100000:2.0:1788864081.417742:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205628800 00000100:00100000:2.0:1788864081.417745:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205628800 00000100:00100000:2.0:1788864081.417759:0:24138:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205629312 00000100:00100000:2.0:1788864081.417761:0:24138:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205629312 00000100:00100000:2.0:1788864081.417778:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:2.0:1788864081.417788:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2411:x1875759205629184:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788864081.417858:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2411:x1875759205629184:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 70us (7333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864081.417865:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 26 00000100:00100000:2.0:1788864081.417883:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:2.0:1788864081.417889:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+8:2411:x1875759205628800:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788864081.417923:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+8:2411:x1875759205628800:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 34us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864081.417929:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 27 00000100:00100000:2.0:1788864081.417943:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:2.0:1788864081.417949:0:24138:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2411:x1875759205629312:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788864081.417970:0:24138:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2411:x1875759205629312:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 21us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864081.417975:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 28 00000100:00100000:2.0:1788864081.417994:0:22621:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205628288 00000100:00100000:2.0:1788864081.417998:0:22621:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205628288 00000100:00100000:2.0:1788864081.418025:0:22621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 168 00000100:00100000:2.0:1788864081.418030:0:22621:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e645ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+13:2411:x1875759205628288:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788864081.418054:0:22621:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e645ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2ec3653-9477-4478-8f1a-11c954453104+13:2411:x1875759205628288:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 24us (7485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864081.418059:0:22621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 168 00000100:00100000:2.0:1788864081.418132:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205628544 00000100:00100000:2.0:1788864081.418136:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205628544 00000100:00100000:2.0:1788864081.418163:0:22630:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1875759205629056 00000100:00100000:2.0:1788864081.418166:0:22630:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1875759205629056 00000100:00100000:2.0:1788864081.418184:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:2.0:1788864081.418190:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2411:x1875759205628544:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788864081.418218:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e0abd44-6bd0-46c6-b6fe-79602dd710f8+5:2411:x1875759205628544:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 28us (7622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864081.418224:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 69 00000100:00100000:2.0:1788864081.418237:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00100000:2.0:1788864081.418251:0:22630:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff89e67e2e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2411:x1875759205629056:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1788864081.418273:0:22630:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff89e67e2e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d816ac8c-ee9e-4499-ba04-38b88aa964f3+5:2411:x1875759205629056:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 24us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788864081.418279:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 70 00000100:00080000:0.0:1788864081.418452:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788864081.418456:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788864081.418459:0:22624:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788864081.579328:0:22616:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 15213 lines, 15213 kept, 0 dropped, 0 bad.