00010000:00010000:2.0F:1789607662.497997:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1789607662.820054:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150125696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0F:1789607662.820076:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150125568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607662.820156:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607662.820191:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150125568 00000100:00100000:3.0:1789607662.820210:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150125568 00000100:00080000:1.0F:1789607662.820273:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607662.820294:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607662.820304:0:17742:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789607662.820310:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150125568:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607662.820332:0:17742:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1789607662.820352:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607662.825154:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607662.825238:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150125696 00000100:00100000:1.0:1789607662.825249:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150125696 00000100:00100000:1.0:1789607662.825309:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607662.825318:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150125696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607662.825343:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607662.825420:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150125696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607662.825427:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789607662.825462:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607662.825500:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150125696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607662.826291:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150125568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5980us (6131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607662.826300:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789607662.837407:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150125568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607663.108325:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607663.108367:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607663.108444:0:17743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130129536 00000100:00100000:1.0:1789607663.108452:0:17743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130129536 00002000:00100000:1.0:1789607663.108496:0:17743:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff8d77c52afb80 x1876539130129536/t0(0) o4->5229d179-f1d7-42df-bf19-19cb16e792a3@192.168.203.25@tcp:219/0 lens 504/0 e 0 to 0 dl 1789607674 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789607663.108508:0:17743:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d77c52afb80 with x1876539130129536 ext(0->8) 00002000:00010000:1.0:1789607663.108514:0:17743:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d77c52afb80 00000100:00100000:1.0:1789607663.108539:0:17743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:1.0:1789607663.108548:0:17743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2395:x1876539130129536:12345-192.168.203.25@tcp:4:bash.0 00000100:00100000:1.0:1789607663.109078:0:17743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+8:2395:x1876539130129536:12345-192.168.203.25@tcp:4:bash.0 Request processed in 530us (760us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789607663.109087:0:17743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00002000:00100000:1.0:1789607663.109094:0:17743:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff8d77c52afb80 x1876539130129536/t8589934599(0) o4->5229d179-f1d7-42df-bf19-19cb16e792a3@192.168.203.25@tcp:219/0 lens 504/448 e 0 to 0 dl 1789607674 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789607663.109115:0:17743:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d77c52afb80 with x1876539130129536 ext(0->8) 00002000:00010000:1.0:1789607663.109119:0:17743:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d77c52afb80 00000100:00100000:0.0:1789607663.110047:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130129664 00000100:00100000:0.0:1789607663.110057:0:17740:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130129664 00000100:00100000:0.0:1789607663.110103:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:0.0:1789607663.110112:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+8:2395:x1876539130129664:12345-192.168.203.25@tcp:16:kworker.0 00000001:00080000:3.0:1789607663.170615:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000100:00100000:0.0:1789607663.175785:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2395:x1876539130129664:12345-192.168.203.25@tcp:16:kworker.0 Request processed in 65662us (67404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607663.176353:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 32 00010000:00010000:3.0:1789607663.522200:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607663.842147:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150125952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607663.842147:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150125824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607663.842354:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607663.842495:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150125824 00000100:00100000:3.0:1789607663.842503:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150125824 00000100:00100000:3.0:1789607663.842544:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607663.842552:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150125824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607663.842587:0:16434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607663.844035:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150125824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1477us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607663.844046:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789607663.844153:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150125824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607663.844249:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607663.844384:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150125952 00000100:00100000:0.0:1789607663.844392:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150125952 00000100:00100000:0.0:1789607663.844452:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789607663.844460:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150125952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607663.844496:0:16433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607663.844547:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150125952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607663.844553:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789607663.844609:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150125952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607664.358067:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150126080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607664.358178:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607664.358233:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150126208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607664.358273:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607664.358317:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150126080 00000100:00100000:2.0:1789607664.358324:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150126080 00000100:00100000:2.0:1789607664.358372:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150126208 00000100:00100000:2.0:1789607664.358376:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150126208 00000100:00100000:2.0:1789607664.358396:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607664.358403:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150126080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789607664.358424:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789607664.358465:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150126080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607664.358471:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607664.358488:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789607664.358495:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150126208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607664.358504:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789607664.358531:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150126208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607664.358538:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789607664.358553:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607664.358578:0:3470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1789607664.358582:0:3470:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d7900a54000, transno 8589934596 00000004:00080000:2.0:1789607664.358598:0:3470:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1789607664.358623:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150126208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607664.359010:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150126080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607664.362856:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150126464:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.362936:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607664.362983:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150126976:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363007:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607664.363025:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150127488:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363048:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607664.363074:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789607664.363080:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150126592:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363101:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607664.363120:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150127104:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363140:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607664.363157:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150127616:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363175:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607664.363205:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150126464 00000100:00100000:2.0:1789607664.363211:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150126464 00000100:00100000:2.0:1789607664.363261:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789607664.363269:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150126464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363318:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150126464:12345-0@lo:400:kworker.0 Request processed in 50us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607664.363324:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789607664.363346:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150126976 00000100:00100000:2.0:1789607664.363349:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150126976 00000100:00100000:2.0:1789607664.363395:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150126592 00000100:00100000:2.0:1789607664.363398:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150126592 00000100:00100000:2.0:1789607664.363417:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607664.363423:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150126976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363453:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150126976:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607664.363459:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607664.363470:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789607664.363476:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150126592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363500:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150126592:12345-0@lo:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607664.363505:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789607664.363521:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150127488 00000100:00100000:2.0:1789607664.363525:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150127488 00000100:00100000:2.0:1789607664.363549:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150127104 00000100:00100000:2.0:1789607664.363552:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150127104 00000100:00100000:2.0:1789607664.363564:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150127616 00000100:00100000:2.0:1789607664.363567:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150127616 00000100:00100000:2.0:1789607664.363580:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789607664.363586:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150127488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363614:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150127488:12345-0@lo:400:kworker.0 Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607664.363619:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789607664.363631:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789607664.363651:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150127104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363677:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150127104:12345-0@lo:400:kworker.0 Request processed in 40us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607664.363691:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789607664.363704:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789607664.363710:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150127616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363737:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3468:x1876539150127616:12345-0@lo:400:kworker.0 Request processed in 29us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607664.363743:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789607664.363786:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150126336:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363816:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607664.363842:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150126848:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363886:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607664.363905:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150127360:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363929:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607664.363947:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789607664.363952:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150126720:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.363970:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607664.363988:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150127232:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364007:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607664.364032:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150126336 00000100:00100000:2.0:1789607664.364036:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150126336 00000100:00100000:2.0:1789607664.364063:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789607664.364070:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3471:x1876539150126336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364103:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3471:x1876539150126336:12345-0@lo:400:kworker.0 Request processed in 34us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607664.364109:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789607664.364142:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150126848 00000100:00100000:2.0:1789607664.364146:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150126848 00000100:00100000:2.0:1789607664.364168:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789607664.364174:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7900a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150126848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364203:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7900a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150126848:12345-0@lo:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607664.364208:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789607664.364225:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150127360 00000100:00100000:2.0:1789607664.364230:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150127360 00000100:00100000:2.0:1789607664.364250:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150126720 00000100:00100000:2.0:1789607664.364252:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150126720 00000100:00100000:2.0:1789607664.364261:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150127232 00000100:00100000:2.0:1789607664.364263:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150127232 00000100:00100000:2.0:1789607664.364275:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789607664.364280:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150127360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364309:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150127360:12345-0@lo:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607664.364315:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789607664.364325:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789607664.364331:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150126720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364356:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150126720:12345-0@lo:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607664.364361:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789607664.364370:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789607664.364376:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150127232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364400:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150127232:12345-0@lo:400:kworker.0 Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607664.364413:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1789607664.364433:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607664.364437:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607664.364439:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607664.364475:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150126720:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364487:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150127232:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364495:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150126336:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364502:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150126848:0@lo:400:kworker.0 00010000:00080000:2.0:1789607664.364512:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cf7ca300 x1876539150127360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607664.364521:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150127360:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364556:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150126592:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364566:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150127104:0@lo:400:kworker.0 00010000:00080000:2.0:1789607664.364576:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cf7c8000 x1876539150127616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607664.364584:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3468:1876539150127616:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364594:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150126464:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364602:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150126976:0@lo:400:kworker.0 00000100:00100000:2.0:1789607664.364612:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150127488:0@lo:400:kworker.0 00000001:00080000:2.0:1789607664.418042:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934632 is committed 00000001:00080000:2.0:1789607664.418077:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934633 is committed 00000020:00080000:2.0:1789607664.418086:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d78d941ca80 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:2.0:1789607664.418091:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78f9cda400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d78d941c780 00000020:00080000:2.0:1789607664.418095:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d78f9cda900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d77c50a0000 00000001:00080000:2.0:1789607664.418108:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000020:00080000:2.0:1789607664.418127:0:16469:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:2.0:1789607664.418287:0:16469:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789607664.418348:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbef0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607664.418361:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbef0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607664.418368:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbef0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607664.418374:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607664.418379:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbef0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607664.418395:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbef0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607664.418411:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:0.0:1789607664.418414:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607664.418419:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbef0f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607664.418425:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9185e00/0xa26202d240fbef0f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607664.549838:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607664.736594:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607664.738234:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130129792 00000100:00100000:0.0:1789607664.738246:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130129792 00000100:00080000:2.0:1789607664.738295:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607664.738429:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:0.0:1789607664.738440:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+11:15688:x1876539130129792:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789607664.738544:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+11:15688:x1876539130129792:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 Request processed in 105us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607664.738552:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:2.0:1789607664.740962:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607664.741180:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130129920 00000100:00100000:0.0:1789607664.741190:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130129920 00000100:00100000:0.0:1789607664.741267:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00100000:0.0:1789607664.741277:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+5:15688:x1876539130129920:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1789607664.741311:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607664.741381:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+5:15688:x1876539130129920:12345-192.168.203.25@tcp:60:lhsmtool_posix.0 Request processed in 106us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607664.741388:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00100000:0.0:1789607664.748696:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607664.748775:0:16431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130130176 00000100:00100000:3.0:1789607664.748784:0:16431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130130176 00000100:00100000:3.0:1789607664.748836:0:16431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1789607664.748846:0:16431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c7b8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+11:15688:x1876539130130176:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789607664.749157:0:16431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c7b8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+12:15688:x1876539130130176:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 312us (466us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1789607664.749171:0:16431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00010000:00010000:3.0:1789607665.572967:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607666.595942:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607667.222720:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607667.222756:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130130304 00000100:00100000:0.0:1789607667.222765:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607667.222767:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130130304 00000100:00100000:0.0:1789607667.222790:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607667.222818:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607667.222822:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 167 00000100:00100000:3.0:1789607667.222835:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:2393:x1876539130130304:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607667.222844:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607667.222882:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607667.223393:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+13:2393:x1876539130130304:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 558us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607667.223401:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 167 00000100:00100000:2.0:1789607667.224406:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130130560 00000100:00100000:1.0:1789607667.224406:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130130432 00000100:00100000:2.0:1789607667.224417:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130130560 00000100:00100000:1.0:1789607667.224417:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130130432 00000100:00100000:1.0:1789607667.224472:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:1.0:1789607667.224481:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+12:2393:x1876539130130432:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607667.226338:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607667.226399:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607667.226427:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607667.226451:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130131072 00000100:00100000:0.0:1789607667.226459:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130131072 00000100:00100000:1.0:1789607667.227937:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+12:2393:x1876539130130432:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 3450us (5139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607667.227949:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 70 00000100:00100000:1.0:1789607667.227989:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130130944 00000100:00100000:1.0:1789607667.227997:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130130944 00000100:00100000:2.0:1789607667.231879:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:2.0:1789607667.231898:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2393:x1876539130130560:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607667.231978:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2393:x1876539130130560:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 88us (9213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607667.231986:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 71 00000100:00100000:2.0:1789607667.232019:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130130688 00000100:00100000:2.0:1789607667.232026:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130130688 00000100:00100000:2.0:1789607667.232051:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130131200 00000100:00100000:2.0:1789607667.232055:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130131200 00000100:00100000:2.0:1789607667.232070:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130131328 00000100:00100000:2.0:1789607667.232073:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130131328 00000100:00100000:2.0:1789607667.232085:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130130816 00000100:00100000:2.0:1789607667.232087:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130130816 00000100:00100000:2.0:1789607667.232103:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:2.0:1789607667.232110:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2394:x1876539130130816:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607667.232149:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2394:x1876539130130816:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 40us (5820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607667.232156:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:2.0:1789607667.232169:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:2.0:1789607667.232177:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2392:x1876539130130688:12345-192.168.203.25@tcp:9:kworker.0 00000020:00000080:2.0:1789607667.232194:0:17737:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbebd5 00000100:00080000:2.0:1789607667.232208:0:17737:0:(import.c:65:import_set_state_nolock()) ffff8d78f77bf800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789607667.232249:0:17737:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1789607667.232377:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607667.232468:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+2:2392:x1876539130130688:12345-192.168.203.25@tcp:9:kworker.0 Request processed in 292us (9650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607667.232476:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:2.0:1789607667.232488:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:2.0:1789607667.232495:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2392:x1876539130131200:12345-192.168.203.25@tcp:9:kworker.0 00000020:00000080:2.0:1789607667.232506:0:17737:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbec14 00000100:00080000:2.0:1789607667.232512:0:17737:0:(import.c:65:import_set_state_nolock()) ffff8d78fce63000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789607667.232538:0:17737:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1789607667.232670:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607667.232692:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:1.0:1789607667.232700:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2394:x1876539130130944:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607667.232730:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2394:x1876539130130944:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 31us (6302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607667.232736:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 72 00000100:00100000:3.0:1789607667.232918:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:3.0:1789607667.232929:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2392:x1876539130131328:12345-192.168.203.25@tcp:9:kworker.0 00000020:00000080:3.0:1789607667.232944:0:17739:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbec1b 00000100:00080000:3.0:1789607667.232953:0:17739:0:(import.c:65:import_set_state_nolock()) ffff8d78fce65000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789607667.233426:0:17739:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1789607667.233638:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+2:2392:x1876539130131328:12345-192.168.203.25@tcp:9:kworker.0 Request processed in 711us (10774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607667.233646:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 35 00010000:00010000:3.0:1789607667.233688:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607667.238496:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7995d486-89d1-4e60-a37c-33f943ccf6a0+2:2392:x1876539130131200:12345-192.168.203.25@tcp:9:kworker.0 Request processed in 5992us (15645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607667.238510:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00080000:2.0:1789607667.238549:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607667.238555:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607667.238558:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607667.238562:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607667.242922:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 73 00000100:00100000:0.0:1789607667.242939:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2394:x1876539130131072:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607667.243324:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2394:x1876539130131072:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 389us (16924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607667.243334:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 73 00010000:00010000:3.0:1789607667.618109:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607667.938145:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150127744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607667.938218:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607667.938302:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150127744 00000100:00100000:2.0:1789607667.938309:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150127744 00000100:00100000:2.0:1789607667.938360:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789607667.938373:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150127744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607667.938404:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607667.938451:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150127744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607667.938459:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789607667.938479:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607667.938511:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150127744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607667.944296:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607667.944319:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fce7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150127872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607667.944388:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607667.944492:0:19384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150127872 00000100:00100000:1.0:1789607667.944502:0:19384:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150127872 00000100:00100000:1.0:1789607667.944572:0:19384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607667.944582:0:19384:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150127872:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789607667.944622:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789607667.944624:0:19384:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607667.944681:0:19384:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150127872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607667.944700:0:19384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789607667.944946:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fce7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150127872:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789607668.201375:0:16464:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789607668.201384:0:16464:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607668.201422:0:16464:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789607668.201429:0:16464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00100000:3.0:1789607668.479418:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7995d486-89d1-4e60-a37c-33f943ccf6a0 00000020:00000080:3.0:1789607668.479428:0:9077:0:(genops.c:885:class_export_put()) final put ffff8d78fce62000/7995d486-89d1-4e60-a37c-33f943ccf6a0 00000020:00000080:0.0:1789607668.479514:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fce62000/7995d486-89d1-4e60-a37c-33f943ccf6a0 for lustre-OST0001 00000020:00000080:0.0:1789607668.479774:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78fce65000 for lustre-OST0001 00010000:00010000:0.0:1789607668.642703:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607668.962391:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607668.962412:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150128000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607668.962520:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607668.962568:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150128000 00000100:00100000:2.0:1789607668.962573:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150128000 00000100:00100000:2.0:1789607668.962640:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789607668.962650:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150128000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789607668.962690:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789607668.962735:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150128000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607668.962741:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789607668.962789:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150128000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607668.963319:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150128128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607668.963354:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607668.963398:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150128128 00000100:00100000:1.0:1789607668.963404:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150128128 00000100:00100000:1.0:1789607668.963438:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789607668.963446:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150128128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607668.963469:0:16433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607668.963508:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150128128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607668.963515:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789607668.964337:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150128128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607669.477984:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150128256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607669.478059:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607669.478099:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607669.478106:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150128384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607669.478129:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607669.478383:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150128256 00000100:00100000:2.0:1789607669.478392:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150128256 00000100:00100000:2.0:1789607669.478445:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150128384 00000100:00100000:2.0:1789607669.478450:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150128384 00000100:00100000:2.0:1789607669.478475:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789607669.478484:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150128256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789607669.478516:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607669.478567:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150128256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607669.478574:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789607669.478775:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789607669.478785:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150128384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607669.478797:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607669.479317:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150128384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 533us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607669.479325:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789607669.480430:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150128512:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.480495:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607669.480532:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150129024:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.480561:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607669.480595:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150129536:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.480627:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607669.480658:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789607669.480664:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150128640:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.480684:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607669.480701:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150129152:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.480721:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607669.480736:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c4411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150129664:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.480754:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607669.480781:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150128896:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.480801:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607669.480817:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150129408:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.480836:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607669.480852:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789607669.480857:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150128768:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.480895:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607669.480911:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150129280:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.480931:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607669.480940:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f77ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150129792:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.481264:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607669.481292:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150128512 00000100:00100000:3.0:1789607669.481306:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150128512 00000100:00100000:3.0:1789607669.481348:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789607669.481356:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3468:x1876539150128512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.481401:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3468:x1876539150128512:12345-0@lo:400:kworker.0 Request processed in 46us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607669.481408:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789607669.481437:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150129024 00000100:00100000:3.0:1789607669.481441:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150129024 00000100:00100000:3.0:1789607669.481463:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150128640 00000100:00100000:3.0:1789607669.481466:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150128640 00000100:00100000:3.0:1789607669.481480:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607669.481486:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150129024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.481519:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150129024:12345-0@lo:400:kworker.0 Request processed in 33us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607669.481525:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607669.481538:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789607669.481543:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150128640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.481569:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150128640:12345-0@lo:400:kworker.0 Request processed in 26us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607669.481575:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789607669.481612:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150129152 00000100:00100000:3.0:1789607669.481616:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150129152 00000100:00100000:3.0:1789607669.481645:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150128768 00000100:00100000:3.0:1789607669.481648:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150128768 00000100:00100000:3.0:1789607669.481669:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789607669.481676:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150129152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.481707:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150129152:12345-0@lo:400:kworker.0 Request processed in 31us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607669.481719:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789607669.481730:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607669.481736:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150128768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.481768:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150128768:12345-0@lo:400:kworker.0 Request processed in 32us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607669.481774:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607669.481790:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150129536 00000100:00100000:3.0:1789607669.481794:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150129536 00000100:00100000:3.0:1789607669.481812:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150129664 00000100:00100000:3.0:1789607669.481814:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150129664 00000100:00100000:3.0:1789607669.481822:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150128896 00000100:00100000:3.0:1789607669.481824:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150128896 00000100:00100000:3.0:1789607669.481832:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150129408 00000100:00100000:3.0:1789607669.481834:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150129408 00000100:00100000:3.0:1789607669.481845:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150129280 00000100:00100000:3.0:1789607669.481847:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150129280 00000100:00100000:3.0:1789607669.481855:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150129792 00000100:00100000:3.0:1789607669.481858:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150129792 00000100:00100000:3.0:1789607669.481891:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789607669.481898:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150129536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.481927:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150129536:12345-0@lo:400:kworker.0 Request processed in 30us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607669.481932:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789607669.481943:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789607669.481949:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150129664:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789607669.482143:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607669.482148:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607669.482150:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607669.482153:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607669.482199:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150128384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607669.482226:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150128256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607669.483700:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150129664:12345-0@lo:400:kworker.0 Request processed in 1748us (2941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607669.483712:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789607669.483745:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789607669.484101:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150128896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.484140:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150128896:12345-0@lo:400:kworker.0 Request processed in 388us (3337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607669.484146:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789607669.484160:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789607669.484166:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150129408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.484196:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1876539150129408:12345-0@lo:400:kworker.0 Request processed in 31us (3359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607669.484201:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789607669.484216:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789607669.484223:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150129280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.484250:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150129280:12345-0@lo:400:kworker.0 Request processed in 29us (3319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607669.484255:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789607669.484270:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789607669.484279:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150129792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.484307:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150129792:12345-0@lo:400:kworker.0 Request processed in 32us (3044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607669.484313:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789607669.484382:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150128768:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.484395:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150129280:0@lo:400:kworker.0 00010000:00080000:3.0:1789607669.484406:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78f77ca300 x1876539150129792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607669.484431:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f77ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150129792:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.484444:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150128896:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.484454:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3471:1876539150129408:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.484495:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150128640:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.484505:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150129152:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.484515:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150129664:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.484526:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3468:1876539150128512:0@lo:400:kworker.0 00000100:00100000:3.0:1789607669.484535:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150129024:0@lo:400:kworker.0 00010000:00080000:3.0:1789607669.484548:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d77c4412a00 x1876539150129536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607669.484556:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c4412a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150129536:0@lo:400:kworker.0 00000020:00080000:3.0:1789607669.526710:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000001:00080000:3.0:1789607669.526743:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:2.0:1789607669.526902:0:16469:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1789607669.526927:0:16469:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:3.0:1789607669.667033:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789607669.861631:0:17083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789607670.690308:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789607671.054499:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7995d486-89d1-4e60-a37c-33f943ccf6a0 00000020:00000080:1.0:1789607671.054510:0:8140:0:(genops.c:885:class_export_put()) final put ffff8d78fce63800/7995d486-89d1-4e60-a37c-33f943ccf6a0 00000001:00100000:1.0:1789607671.054765:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5229d179-f1d7-42df-bf19-19cb16e792a3 00000020:00000080:1.0:1789607671.054769:0:8140:0:(genops.c:885:class_export_put()) final put ffff8d78f77bd000/5229d179-f1d7-42df-bf19-19cb16e792a3 00000020:00000080:0.0:1789607671.059401:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fce63800/7995d486-89d1-4e60-a37c-33f943ccf6a0 for lustre-OST0000 00000020:00000080:2.0:1789607671.059597:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78fce63000 for lustre-OST0000 00000020:00000080:1.0:1789607671.059936:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f77bd000/5229d179-f1d7-42df-bf19-19cb16e792a3 for lustre-OST0000 00000020:00000080:1.0:1789607671.059970:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78f77bf800 for lustre-OST0000 00010000:00010000:3.0:1789607671.718390:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607672.326641:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607672.326688:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607672.326716:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607672.326750:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607672.326773:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607672.326796:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607672.326829:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130131712 00000100:00100000:3.0:1789607672.326839:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130131712 00000100:00100000:3.0:1789607672.326908:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130131968 00000100:00100000:3.0:1789607672.326924:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130131968 00000100:00100000:3.0:1789607672.326939:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130131584 00000100:00100000:3.0:1789607672.326941:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130131584 00000100:00100000:3.0:1789607672.326952:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130132096 00000100:00100000:3.0:1789607672.326955:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130132096 00000100:00100000:3.0:1789607672.326982:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00100000:3.0:1789607672.326990:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2393:x1876539130131712:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607672.327071:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2393:x1876539130131712:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 82us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607672.327078:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 80 00000100:00100000:3.0:1789607672.327095:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 81 00000100:00100000:3.0:1789607672.327101:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2393:x1876539130131968:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607672.327124:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2393:x1876539130131968:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 24us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607672.327130:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 81 00000100:00100000:3.0:1789607672.327142:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 82 00000100:00100000:3.0:1789607672.327147:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+11:2393:x1876539130131584:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607672.327171:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5229d179-f1d7-42df-bf19-19cb16e792a3+11:2393:x1876539130131584:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 24us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607672.327176:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 82 00000100:00100000:3.0:1789607672.327187:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:3.0:1789607672.327194:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2393:x1876539130132096:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607672.327213:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2393:x1876539130132096:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 20us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607672.327225:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 83 00000100:00100000:3.0:1789607672.327251:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130131840 00000100:00100000:3.0:1789607672.327255:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130131840 00000100:00100000:3.0:1789607672.327282:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:3.0:1789607672.327288:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f77ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2393:x1876539130131840:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607672.327313:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f77ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2393:x1876539130131840:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607672.327318:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00080000:3.0:1789607672.327337:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607672.327342:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607672.327344:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607672.327442:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130131456 00000100:00100000:0.0:1789607672.327452:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130131456 00000100:00100000:0.0:1789607672.327487:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 169 00000100:00100000:0.0:1789607672.327494:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+13:2393:x1876539130131456:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607672.327534:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0558d189-bcbe-419b-abe6-53549136797c+13:2393:x1876539130131456:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 41us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607672.327541:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 169 00010000:00010000:0.0:1789607672.738935:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789607672.845842:0:20072:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 21:14:32 (1789607672) 00000100:00100000:1.0:1789607673.060140:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607673.060162:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150129920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607673.060242:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607673.060303:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150129920 00000100:00100000:1.0:1789607673.060312:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150129920 00000100:00100000:1.0:1789607673.060366:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789607673.060376:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150129920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789607673.060420:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607673.060464:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150129920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607673.060471:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789607673.060493:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607673.060529:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150129920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607673.064394:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607673.064416:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150130048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607673.064483:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607673.064853:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150130048 00000100:00100000:2.0:1789607673.064890:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150130048 00000100:00080000:1.0:1789607673.064964:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607673.064967:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789607673.064979:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150130048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607673.065000:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607673.065056:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150130048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607673.065063:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789607673.065761:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150130048:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789607673.762168:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607674.082197:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150130176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607674.082318:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607674.082611:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607674.082621:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150130304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607674.082649:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.082808:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150130176 00000100:00100000:3.0:1789607674.082817:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150130176 00000100:00100000:3.0:1789607674.082892:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150130304 00000100:00100000:3.0:1789607674.082896:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150130304 00000100:00100000:3.0:1789607674.082915:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789607674.082923:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150130176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607674.082963:0:16433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607674.083020:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150130176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.083027:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789607674.083046:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789607674.083053:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150130304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607674.083074:0:16433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789607674.083110:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150130304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.083130:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789607674.083173:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150130304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607674.083270:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150130176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607674.594107:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fce7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150130432:0@lo:400:kworker.0 00000100:00100000:1.0:1789607674.594184:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607674.594340:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150130432 00000100:00100000:2.0:1789607674.594349:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150130432 00000100:00100000:2.0:1789607674.594401:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789607674.594411:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3471:x1876539150130432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.594772:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fce7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150130816:0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.594808:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.594858:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150130816 00000100:00100000:3.0:1789607674.594894:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150130816 00000100:00100000:3.0:1789607674.594923:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789607674.594929:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150130816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.594962:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150130816:12345-0@lo:400:kworker.0 Request processed in 33us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.594969:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789607674.595030:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fce7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150130816:0@lo:400:kworker.0 00000100:00100000:0.0:1789607674.602096:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fce7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150130560:0@lo:400:kworker.0 00000100:00100000:0.0:1789607674.602167:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.602218:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150130560 00000100:00100000:3.0:1789607674.602228:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150130560 00000100:00100000:0.0:1789607674.602231:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607674.602239:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fce7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150130688:0@lo:400:kworker.0 00000100:00100000:0.0:1789607674.602280:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.602284:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789607674.602295:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fce7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150130560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607674.602368:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150131072:0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.602371:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fce7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150130560:12345-0@lo:400:kworker.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.602381:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789607674.602398:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150130688 00000100:00100000:0.0:1789607674.602402:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.602404:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150130688 00000100:00100000:3.0:1789607674.602435:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150131072 00000100:00100000:3.0:1789607674.602439:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150131072 00000100:00100000:3.0:1789607674.602458:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789607674.602464:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150130688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.602505:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150130688:12345-0@lo:400:kworker.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.602512:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789607674.602524:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607674.602542:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150131072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.602579:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150131072:12345-0@lo:400:kworker.0 Request processed in 49us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.602584:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607674.602609:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607674.602618:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150130944:0@lo:400:kworker.0 00000100:00100000:0.0:1789607674.602626:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150131072:0@lo:400:kworker.0 00000100:00100000:0.0:1789607674.602639:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fce7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150130688:0@lo:400:kworker.0 00000100:00100000:0.0:1789607674.602656:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fce7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150130560:0@lo:400:kworker.0 00000100:00100000:0.0:1789607674.602701:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150131200:0@lo:400:kworker.0 00000100:00100000:0.0:1789607674.602731:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607674.602786:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150131584:0@lo:400:kworker.0 00000100:00100000:0.0:1789607674.602809:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607674.602857:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150131712:0@lo:400:kworker.0 00000100:00100000:0.0:1789607674.602901:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.603045:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.603081:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150131328:0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.603103:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.603122:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607674.603127:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150131456:0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.603147:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.603172:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150130944 00000100:00100000:3.0:1789607674.603176:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150130944 00000100:00100000:3.0:1789607674.603206:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789607674.603214:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150130944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.603258:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150130944:12345-0@lo:400:kworker.0 Request processed in 45us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.603263:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789607674.603283:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150131200 00000100:00100000:3.0:1789607674.603286:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150131200 00000100:00100000:3.0:1789607674.603302:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150131584 00000100:00100000:3.0:1789607674.603312:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150131584 00000100:00100000:3.0:1789607674.603338:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150131712 00000100:00100000:3.0:1789607674.603341:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150131712 00000100:00100000:3.0:1789607674.603353:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150131328 00000100:00100000:3.0:1789607674.603356:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150131328 00000100:00100000:3.0:1789607674.603374:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150131456 00000100:00100000:3.0:1789607674.603377:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150131456 00000100:00100000:3.0:1789607674.603391:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789607674.603397:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150131200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.603438:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150131200:12345-0@lo:400:kworker.0 Request processed in 41us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.603444:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789607674.603458:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789607674.603464:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150131584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607674.603473:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150131200:0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.603501:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3468:x1876539150131584:12345-0@lo:400:kworker.0 Request processed in 37us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.603506:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789607674.603517:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789607674.603522:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539150131712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.603729:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539150131712:12345-0@lo:400:kworker.0 Request processed in 206us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.603736:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789607674.603750:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789607674.603756:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150131328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.603779:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150131328:12345-0@lo:400:kworker.0 Request processed in 25us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.603784:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789607674.603808:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789607674.603815:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150131456:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789607674.603818:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78ff79c380 x1876539150131712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607674.603832:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150131712:0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.604014:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150131456:12345-0@lo:400:kworker.0 Request processed in 46us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.604022:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1789607674.604684:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78ff79e680 x1876539150131456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607674.604695:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150131456:0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.604730:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150131328:0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.604743:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150130944:0@lo:400:kworker.0 00000100:00100000:3.0:1789607674.604776:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150131584:0@lo:400:kworker.0 00000100:00080000:0.0:1789607674.606433:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607674.606442:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607674.606444:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607674.611536:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fce7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150130432:0@lo:400:kworker.0 00000100:00100000:2.0:1789607674.611630:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efafb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3471:x1876539150130432:12345-0@lo:400:kworker.0 Request processed in 17218us (17452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.611643:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789607674.612827:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150131840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607674.612906:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607674.612941:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607674.612949:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150131968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607674.612973:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607674.613009:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150131840 00000100:00100000:1.0:1789607674.613016:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150131840 00000100:00100000:1.0:1789607674.613058:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150131968 00000100:00100000:1.0:1789607674.613061:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150131968 00000100:00100000:1.0:1789607674.613079:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789607674.613087:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150131840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789607674.613122:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607674.613168:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150131840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607674.613198:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789607674.613220:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789607674.613228:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150131968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607674.613239:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607674.613269:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150131968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607674.613275:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789607674.613322:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150131968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607674.613340:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150131840:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789607674.786024:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607675.812820:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607676.347620:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607676.347660:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607676.347894:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130132224 00000100:00100000:0.0:1789607676.347903:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130132224 00000100:00100000:0.0:1789607676.347962:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130132352 00000100:00100000:0.0:1789607676.347966:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130132352 00000100:00100000:0.0:1789607676.347990:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:0.0:1789607676.347999:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d9245c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0558d189-bcbe-419b-abe6-53549136797c+14:2393:x1876539130132224:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607676.348015:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607676.348035:0:16415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fcf76e00/0xa26202d240fbebb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c66 expref: 14 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607676.348071:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607676.348126:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d9245c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0558d189-bcbe-419b-abe6-53549136797c+13:2393:x1876539130132224:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 127us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607676.348133:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:0.0:1789607676.348177:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:0.0:1789607676.348184:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0558d189-bcbe-419b-abe6-53549136797c+12:2393:x1876539130132352:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607676.348192:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607676.348201:0:16415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fcf77600/0xa26202d240fbec76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d4d expref: 12 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607676.348211:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607676.348229:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0558d189-bcbe-419b-abe6-53549136797c+11:2393:x1876539130132352:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 45us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607676.348235:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:3.0:1789607676.348625:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607676.348792:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607676.348858:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130132608 00000100:00100000:0.0:1789607676.348893:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130132608 00000100:00100000:0.0:1789607676.348933:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:0.0:1789607676.348941:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+6:2392:x1876539130132608:12345-192.168.203.25@tcp:9:umount.0 00000020:00000080:0.0:1789607676.348972:0:17739:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbebdc 00000020:00010000:0.0:1789607676.348979:0:17739:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d77c10a9800: total 0 00000100:00080000:0.0:1789607676.348983:0:17739:0:(import.c:65:import_set_state_nolock()) ffff8d77c10aa000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789607676.349017:0:17739:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1789607676.349251:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+4:2392:x1876539130132608:12345-192.168.203.25@tcp:9:umount.0 Request processed in 310us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607676.349258:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00080000:0.0:1789607676.349284:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:0.0:1789607676.349365:0:16418:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d77c10a9800: total 0 00010000:00010000:0.0:1789607676.349369:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607676.349386:0:16418:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d77c10a9800, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1789607676.349414:0:16418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789607676.349417:0:16418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1789607676.349437:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8688fc4/0xa26202d240fbef40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e26 expref: 3 pid: 17737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607676.349478:0:16418:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d77c10a9800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789607676.349487:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607676.349489:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607676.349490:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607676.356310:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130132736 00000100:00100000:1.0:1789607676.356326:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130132736 00000100:00100000:1.0:1789607676.356453:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:1.0:1789607676.356480:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0558d189-bcbe-419b-abe6-53549136797c+11:2396:x1876539130132736:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607676.356496:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607676.356516:0:16415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd580600/0xa26202d240fbebb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c97 expref: 11 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607676.356532:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607676.356605:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0558d189-bcbe-419b-abe6-53549136797c+10:2396:x1876539130132736:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 128us (7813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607676.356613:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:3.0:1789607676.360194:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607676.360379:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130133632 00000100:00100000:1.0:1789607676.360390:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130133632 00000100:00100000:1.0:1789607676.360479:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 74 00000100:00100000:1.0:1789607676.360491:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+11:2392:x1876539130133632:12345-192.168.203.25@tcp:39:umount.0 00000020:00000080:1.0:1789607676.360537:0:16429:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbebc7 00000020:00010000:1.0:1789607676.360562:0:16429:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d77c10f3000: total 0 00000100:00080000:1.0:1789607676.360567:0:16429:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789607676.360595:0:16429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000100:00080000:2.0:1789607676.360886:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1789607676.360914:0:16417:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d77c10f3000: total 0 00010000:00010000:2.0:1789607676.360956:0:16417:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d77c10f3000, canceled 0 locks, left on hash table 6. 00010000:00010000:2.0:1789607676.360987:0:16417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78c73e1100) 00010000:00010000:2.0:1789607676.360991:0:16417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607676.361012:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075da00/0xa26202d240fbecae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d5b expref: 10 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607676.361083:0:16417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d78d2475000) 00010000:00010000:2.0:1789607676.361087:0:16417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607676.361091:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd581600/0xa26202d240fbee8a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668dee expref: 9 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607676.361108:0:16417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:2.0:1789607676.361111:0:16417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607676.361115:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ce00/0xa26202d240fbeced lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d69 expref: 8 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607676.361129:0:16417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d78d9b83f00) 00010000:00010000:2.0:1789607676.361131:0:16417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789607676.361135:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c9184a00/0xa26202d240fbeee5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e03 expref: 7 pid: 16428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607676.361152:0:16417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d78d2475200) 00010000:00010000:2.0:1789607676.361155:0:16417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607676.361159:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf77a00/0xa26202d240fbec92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d54 expref: 6 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607676.361174:0:16417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d78c6f8cc00) 00010000:00010000:2.0:1789607676.361176:0:16417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789607676.361180:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd580800/0xa26202d240fbed72 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d93 expref: 5 pid: 16429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607676.361193:0:16417:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d77c10f3000, canceled 6 locks, left on hash table 0. 00010000:00010000:2.0:1789607676.361206:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607676.361213:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607676.361215:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607676.361909:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5229d179-f1d7-42df-bf19-19cb16e792a3+3:2392:x1876539130133632:12345-192.168.203.25@tcp:39:umount.0 Request processed in 1418us (1721us total) trans 8589934636 rc 0/0 00000100:00100000:1.0:1789607676.361920:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 74 00000100:00100000:3.0:1789607676.379209:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607676.380628:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130133760 00000100:00100000:0.0:1789607676.380641:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130133760 00000100:00080000:2.0:1789607676.380725:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607676.380825:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 75 00000100:00100000:0.0:1789607676.380838:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+5:2392:x1876539130133760:12345-192.168.203.25@tcp:39:umount.0 00000020:00000080:0.0:1789607676.380895:0:16428:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbebce 00000100:00080000:0.0:1789607676.380913:0:16428:0:(import.c:65:import_set_state_nolock()) ffff8d77c5f22800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789607676.380936:0:16428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1789607676.381100:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607676.381412:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5229d179-f1d7-42df-bf19-19cb16e792a3+3:2392:x1876539130133760:12345-192.168.203.25@tcp:39:umount.0 Request processed in 576us (2210us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789607676.381426:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 75 00010000:00010000:2.0:1789607676.834012:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607677.451503:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607677.451568:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607677.451665:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130133888 00000100:00100000:1.0:1789607677.451706:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130134016 00000100:00100000:1.0:1789607677.451713:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130134016 00000100:00100000:3.0:1789607677.451747:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130133888 00000100:00100000:1.0:1789607677.451792:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 90 00000100:00100000:1.0:1789607677.451807:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2396:x1876539130134016:12345-192.168.203.25@tcp:400:kworker.0 00000100:00080000:2.0:1789607677.451886:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607677.452122:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 171 00000100:00100000:3.0:1789607677.452132:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+10:2395:x1876539130133888:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607677.452232:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2396:x1876539130134016:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 426us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607677.452241:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 90 00000100:00100000:3.0:1789607677.455610:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0558d189-bcbe-419b-abe6-53549136797c+10:2395:x1876539130133888:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 3468us (4106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607677.455642:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 171 00000100:00100000:0.0:1789607677.456000:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607677.456358:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130134144 00000100:00100000:1.0:1789607677.456368:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130134144 00000100:00100000:1.0:1789607677.456442:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 91 00000100:00100000:1.0:1789607677.456451:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2396:x1876539130134144:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607677.456743:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2396:x1876539130134144:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 292us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607677.456750:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 91 00000100:00080000:0.0:1789607677.457257:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789607677.858038:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607678.178171:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150132096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607678.178249:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607678.178489:0:17741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150132096 00000100:00100000:1.0:1789607678.178497:0:17741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150132096 00000100:00100000:1.0:1789607678.178579:0:17741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607678.178590:0:17741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150132096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607678.178622:0:17741:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607678.178683:0:17741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150132096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607678.178690:0:17741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607678.178737:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150132096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789607678.178895:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607678.179037:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150132224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607678.179090:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607678.179207:0:19384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150132224 00000100:00100000:3.0:1789607678.179212:0:19384:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150132224 00000100:00100000:3.0:1789607678.179256:0:19384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789607678.179264:0:19384:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150132224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607678.179276:0:19384:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607678.179310:0:19384:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150132224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607678.179316:0:19384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789607678.179396:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150132224:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789607678.179520:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607678.367659:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607678.367717:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607678.367780:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607678.369325:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130134272 00000100:00100000:1.0:1789607678.369339:0:19178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130134272 00000100:00100000:0.0:1789607678.369434:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130134528 00000100:00100000:0.0:1789607678.369443:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130134528 00000100:00100000:3.0:1789607678.369449:0:16414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130134400 00000100:00100000:3.0:1789607678.369457:0:16414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130134400 00000100:00100000:2.0:1789607678.370260:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:2.0:1789607678.370280:0:16416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0558d189-bcbe-419b-abe6-53549136797c+12:2395:x1876539130134272:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607678.370297:0:16416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607678.370318:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd581c00/0xa26202d240fbebf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668cd6 expref: 12 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607678.370352:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:1.0:1789607678.370363:0:19178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0558d189-bcbe-419b-abe6-53549136797c+12:2395:x1876539130134528:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607678.370377:0:19178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607678.370387:0:19178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075c800/0xa26202d240fbec6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d46 expref: 12 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607678.370404:0:19178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607678.370410:0:16416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607678.370468:0:16416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0558d189-bcbe-419b-abe6-53549136797c+10:2395:x1876539130134272:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 198us (2818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607678.370477:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:2.0:1789607678.370502:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:2.0:1789607678.370510:0:16416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0558d189-bcbe-419b-abe6-53549136797c+9:2395:x1876539130134400:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607678.370543:0:16416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607678.370555:0:16416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075d200/0xa26202d240fbebf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d07 expref: 9 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607678.370564:0:16416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607678.372576:0:19178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0558d189-bcbe-419b-abe6-53549136797c+8:2395:x1876539130134528:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 2168us (4813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607678.372590:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:2.0:1789607678.376056:0:16416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0558d189-bcbe-419b-abe6-53549136797c+7:2395:x1876539130134400:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 5536us (8265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607678.376072:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:2.0:1789607678.385645:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607678.385769:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130134784 00000100:00100000:3.0:1789607678.385781:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130134784 00000100:00100000:3.0:1789607678.385852:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 76 00000100:00100000:3.0:1789607678.385900:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+6:2392:x1876539130134784:12345-192.168.203.25@tcp:39:umount.0 00000020:00000080:3.0:1789607678.385940:0:16430:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbec06 00000020:00010000:3.0:1789607678.385950:0:16430:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d78fce60800: total 0 00000100:00080000:3.0:1789607678.385955:0:16430:0:(import.c:65:import_set_state_nolock()) ffff8d78fce64800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789607678.385995:0:16430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000020:00010000:0.0:1789607678.386207:0:16417:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d78fce60800: total 0 00010000:00010000:0.0:1789607678.386212:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607678.386335:0:16417:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d78fce60800, canceled 0 locks, left on hash table 1. 00000100:00100000:3.0:1789607678.386481:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2392:x1876539130134784:12345-192.168.203.25@tcp:39:umount.0 Request processed in 618us (844us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1789607678.386489:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 76 00010000:00010000:0.0:1789607678.386544:0:16417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c73e1d00) 00010000:00010000:0.0:1789607678.386549:0:16417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607678.386558:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fcf76c00/0xa26202d240fbecfb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668d70 expref: 4 pid: 17627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607678.386583:0:16417:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d78fce60800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789607678.386597:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607678.386599:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607678.386601:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607678.394632:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607678.394733:0:17627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130134912 00000100:00100000:1.0:1789607678.394743:0:17627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130134912 00000100:00100000:1.0:1789607678.394803:0:17627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 77 00000100:00100000:1.0:1789607678.394814:0:17627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+5:2392:x1876539130134912:12345-192.168.203.25@tcp:39:umount.0 00000020:00000080:1.0:1789607678.394856:0:17627:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbec0d 00000100:00080000:1.0:1789607678.394910:0:17627:0:(import.c:65:import_set_state_nolock()) ffff8d78ef1f5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789607678.394931:0:17627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1789607678.395153:0:17627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7995d486-89d1-4e60-a37c-33f943ccf6a0+3:2392:x1876539130134912:12345-192.168.203.25@tcp:39:umount.0 Request processed in 341us (530us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789607678.395161:0:17627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 77 00010000:00010000:2.0:1789607678.395545:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789607678.434481:0:16464:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789607678.434490:0:16464:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607678.434668:0:16464:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789607678.434677:0:16464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789607678.435482:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607678.435699:0:16423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130135168 00000100:00100000:2.0:1789607678.435708:0:16423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130135168 00000100:00100000:2.0:1789607678.435765:0:16423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 172 00000100:00100000:2.0:1789607678.435776:0:16423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+7:2392:x1876539130135168:12345-192.168.203.25@tcp:251:umount.0 00000020:00000080:2.0:1789607678.435831:0:16423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbeba4 00000020:00010000:2.0:1789607678.435838:0:16423:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d77c10f3800: total 0 00000100:00080000:2.0:1789607678.435842:0:16423:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f2000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789607678.435973:0:16423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0558d189-bcbe-419b-abe6-53549136797c+3:2392:x1876539130135168:12345-192.168.203.25@tcp:251:umount.0 Request processed in 199us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607678.435980:0:16423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 172 00000020:00010000:1.0:1789607678.436050:0:16417:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d77c10f3800: total 0 00010000:00010000:1.0:1789607678.436089:0:16417:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d77c10f3800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789607678.436130:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075cc00/0xa26202d240fbebab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668c5f expref: 2 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607678.436146:0:16417:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d77c10f3800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789607678.436156:0:16417:0:(genops.c:885:class_export_put()) final put ffff8d77c10f3800/0558d189-bcbe-419b-abe6-53549136797c 00010000:00010000:1.0:1789607678.436171:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607678.436174:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607678.436176:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789607678.436333:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c10f3800/0558d189-bcbe-419b-abe6-53549136797c for MGS 00000020:00000080:2.0:1789607678.436371:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c10f2000 for MGS 00000001:00100000:0.0:1789607678.749809:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5229d179-f1d7-42df-bf19-19cb16e792a3 00000020:00000080:0.0:1789607678.749820:0:9077:0:(genops.c:885:class_export_put()) final put ffff8d77c10a9800/5229d179-f1d7-42df-bf19-19cb16e792a3 00000020:00000080:0.0:1789607678.749851:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c10a9800/5229d179-f1d7-42df-bf19-19cb16e792a3 for lustre-OST0001 00000020:00000080:0.0:1789607678.749910:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c10aa000 for lustre-OST0001 00010000:00010000:2.0:1789607678.882026:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789607679.078389:0:17083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789607679.203492:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150132352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607679.203590:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607679.203703:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150132352 00000100:00100000:2.0:1789607679.203712:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150132352 00000100:00100000:2.0:1789607679.203767:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789607679.203781:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150132352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789607679.203840:0:16433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607679.203917:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150132352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607679.203924:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789607679.203966:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150132352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607679.206544:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607679.206565:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150132480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607679.206626:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607679.206677:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150132480 00000100:00100000:2.0:1789607679.206685:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150132480 00000100:00100000:2.0:1789607679.206727:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789607679.206737:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150132480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789607679.206774:0:16434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789607679.206826:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150132480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607679.206832:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789607679.206896:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150132480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607679.714141:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150132608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607679.714223:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607679.714405:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150132608 00000100:00100000:1.0:1789607679.714412:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150132608 00000100:00100000:1.0:1789607679.714464:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607679.714472:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150132608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607679.714507:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607679.716318:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150132608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1840us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607679.716331:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607679.716376:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150132864:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.716419:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607679.716444:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150133376:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.716467:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607679.716487:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150133888:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.716520:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607679.716555:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789607679.716564:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150132992:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.716586:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607679.716603:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150133504:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.716622:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607679.716641:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150134016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607679.716663:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789607679.716697:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607679.716712:0:19384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150134016 00000100:00100000:1.0:1789607679.716718:0:19384:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150134016 00000100:00100000:1.0:1789607679.716764:0:19384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789607679.716773:0:19384:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150134016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789607679.716795:0:19384:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607679.716837:0:19384:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150134016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607679.716843:0:19384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789607679.717030:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150132864 00000100:00100000:3.0:1789607679.717044:0:17737:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150132864 00000100:00100000:3.0:1789607679.717078:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607679.717086:0:17737:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150132864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607679.717128:0:17737:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150132864:12345-0@lo:400:kworker.0 Request processed in 44us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607679.717135:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607679.718203:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150133376 00000100:00100000:3.0:1789607679.718212:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150133376 00000100:00100000:3.0:1789607679.718253:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150133888 00000100:00100000:3.0:1789607679.718257:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150133888 00000100:00100000:3.0:1789607679.718347:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150132992 00000100:00100000:3.0:1789607679.718351:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150132992 00000100:00100000:3.0:1789607679.718363:0:16430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150133504 00000100:00100000:3.0:1789607679.718366:0:16430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150133504 00000100:00100000:3.0:1789607679.718384:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789607679.718540:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c624a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150133376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607679.718614:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c624a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150133376:12345-0@lo:400:kworker.0 Request processed in 222us (2145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607679.718622:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789607679.718641:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789607679.718648:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150133888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607679.718684:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150133888:12345-0@lo:400:kworker.0 Request processed in 38us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607679.718690:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789607679.718702:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789607679.718707:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c624b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150132992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607679.718738:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c624b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150132992:12345-0@lo:400:kworker.0 Request processed in 31us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607679.718754:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789607679.718771:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789607679.718779:0:16430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150133504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607679.718815:0:16430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150133504:12345-0@lo:400:kworker.0 Request processed in 38us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607679.718821:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1789607679.719474:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607679.719480:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607679.719483:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607679.719599:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150132992:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.721162:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150132736:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.721242:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607679.721287:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150133248:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.721313:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607679.721348:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150133760:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.721373:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607679.721399:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789607679.721406:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150133120:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.721425:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607679.721442:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150133632:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.721460:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607679.721491:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150132736 00000100:00100000:1.0:1789607679.721498:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150132736 00000100:00100000:1.0:1789607679.721553:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789607679.721562:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3469:x1876539150132736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607679.721588:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150133248 00000100:00100000:0.0:1789607679.721593:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150133248 00000100:00100000:1.0:1789607679.721616:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3469:x1876539150132736:12345-0@lo:400:kworker.0 Request processed in 55us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607679.721624:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789607679.721627:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150133120 00000100:00100000:0.0:1789607679.721631:0:17739:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150133120 00000100:00100000:0.0:1789607679.721658:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789607679.721662:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150133760 00000100:00100000:1.0:1789607679.721667:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150133760 00000100:00100000:0.0:1789607679.721668:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c624a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150133248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.721707:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150133632 00000100:00100000:1.0:1789607679.721712:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150133632 00000100:00100000:0.0:1789607679.721714:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c624a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150133248:12345-0@lo:400:kworker.0 Request processed in 48us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607679.721722:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789607679.721741:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789607679.721748:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607679.721752:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150133760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607679.721760:0:17739:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150133120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607679.721804:0:17739:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150133120:12345-0@lo:400:kworker.0 Request processed in 48us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607679.721807:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150133760:12345-0@lo:400:kworker.0 Request processed in 46us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607679.721813:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607679.721820:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789607679.721838:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789607679.721848:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c624b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150133632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.722233:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c624b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150133632:12345-0@lo:400:kworker.0 Request processed in 386us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607679.722251:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1789607679.722277:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607679.722281:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607679.722356:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150133504:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.722386:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150134016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607679.722399:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150132864:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.722409:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150133376:0@lo:400:kworker.0 00010000:00080000:1.0:1789607679.722421:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c6248e00 x1876539150133888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607679.722430:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150133888:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.722475:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150132608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607679.722497:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150133120:0@lo:400:kworker.0 00010000:00080000:1.0:1789607679.722508:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c6248a80 x1876539150133632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607679.722515:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150133632:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.722536:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150132736:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.722546:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150133248:0@lo:400:kworker.0 00000100:00100000:1.0:1789607679.722555:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150133760:0@lo:400:kworker.0 00000001:00100000:2.0:1789607679.766496:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5229d179-f1d7-42df-bf19-19cb16e792a3 00000001:00080000:2.0:1789607679.766530:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1789607679.766534:0:7270:0:(genops.c:885:class_export_put()) final put ffff8d77c5f20800/5229d179-f1d7-42df-bf19-19cb16e792a3 00000001:00100000:2.0:1789607679.766551:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7995d486-89d1-4e60-a37c-33f943ccf6a0 00000001:00080000:2.0:1789607679.766556:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1789607679.766559:0:7270:0:(genops.c:885:class_export_put()) final put ffff8d78ef1f2000/7995d486-89d1-4e60-a37c-33f943ccf6a0 00000020:00000080:2.0:1789607679.766571:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c5f20800/5229d179-f1d7-42df-bf19-19cb16e792a3 for lustre-MDT0001 00000020:00000080:2.0:1789607679.766619:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78ef1f2000/7995d486-89d1-4e60-a37c-33f943ccf6a0 for lustre-MDT0001 00000020:00000080:2.0:1789607679.766657:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c5f22800 for lustre-MDT0001 00000020:00000080:2.0:1789607679.766661:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78ef1f5000 for lustre-MDT0001 00000001:00100000:1.0:1789607679.775477:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5229d179-f1d7-42df-bf19-19cb16e792a3 00000001:00080000:1.0:1789607679.775494:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:1.0:1789607679.775516:0:6490:0:(genops.c:885:class_export_put()) final put ffff8d77c10f3000/5229d179-f1d7-42df-bf19-19cb16e792a3 00000020:00000080:2.0:1789607679.775666:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c10f3000/5229d179-f1d7-42df-bf19-19cb16e792a3 for lustre-MDT0000 00000001:00100000:1.0:1789607679.775775:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7995d486-89d1-4e60-a37c-33f943ccf6a0 00000001:00080000:1.0:1789607679.775783:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:1.0:1789607679.775785:0:6490:0:(genops.c:885:class_export_put()) final put ffff8d78fce60800/7995d486-89d1-4e60-a37c-33f943ccf6a0 00000020:00000080:2.0:1789607679.775832:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c10f0800 for lustre-MDT0000 00000020:00000080:2.0:1789607679.775971:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fce60800/7995d486-89d1-4e60-a37c-33f943ccf6a0 for lustre-MDT0000 00000020:00000080:2.0:1789607679.776080:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78fce64800 for lustre-MDT0000 00010000:00010000:1.0:1789607679.907674:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789607680.120178:0:20268:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789607680.134303:0:20268:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789607680.134356:0:20268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.134372:0:20268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.134379:0:20268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.134387:0:20268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.134452:0:20268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789607680.134458:0:20268:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789607680.134479:0:20268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789607680.134484:0:20268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789607680.134490:0:20268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789607680.134514:0:20268:0:(import.c:65:import_set_state_nolock()) ffff8d7900371800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789607680.135676:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539150134144:0@lo:39:umount.0 00000100:00100000:3.0:1789607680.135747:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607680.136010:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150134144 00000100:00100000:1.0:1789607680.136019:0:16429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150134144 00000100:00100000:1.0:1789607680.136076:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789607680.136086:0:16429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3467:x1876539150134144:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789607680.136115:0:16429:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe798 00000100:00080000:1.0:1789607680.136123:0:16429:0:(import.c:65:import_set_state_nolock()) ffff8d78fcd6d800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789607680.136545:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607680.136554:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.136564:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9184000 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607680.136568:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.136578:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607680.136585:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607680.136591:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789607680.136594:0:16418:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789607680.136596:0:16418:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789607680.136728:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.136735:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789607680.136798:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1789607680.136817:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.136826:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9184000/0xa26202d240fbe767 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe76e expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.136856:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607680.136858:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607680.136878:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607680.137593:0:16429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3467:x1876539150134144:12345-0@lo:39:umount.0 Request processed in 1504us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607680.137604:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000020:00000080:1.0:1789607680.137617:0:16429:0:(genops.c:885:class_export_put()) final put ffff8d78fcd69000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1789607680.137699:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d7900371800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789607680.137720:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539150134144:0@lo:39:umount.0 00000100:00100000:2.0:1789607680.138319:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150134272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607680.138381:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607680.138955:0:16414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150134272 00000100:00100000:3.0:1789607680.138963:0:16414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150134272 00000100:00100000:3.0:1789607680.139019:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607680.139028:0:16414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+24:3469:x1876539150134272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607680.139043:0:16414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607680.139061:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7900ef9e00/0xa26202d240fbe76e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbe767 expref: 24 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607680.139076:0:16414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607680.139119:0:16414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:3469:x1876539150134272:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607680.139126:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789607680.139214:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150134272:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789607680.139304:0:20268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789607680.139308:0:20268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789607680.139313:0:20268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789607680.140193:0:20268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607680.140208:0:20268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607680.140215:0:20268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607680.140223:0:20268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.141692:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607680.141704:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.141714:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8a00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607680.141719:0:16417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.141728:0:16417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607680.141734:0:16417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607680.141740:0:16417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789607680.141742:0:16417:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789607680.141790:0:16417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.141797:0:16417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789607680.141852:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150134400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607680.141946:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607680.142032:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150134400 00000100:00100000:3.0:1789607680.142039:0:19178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150134400 00000100:00100000:3.0:1789607680.142091:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789607680.142100:0:19178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d9246050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7095b5c7-e12e-406f-ad0b-bb55e8b45703+23:3469:x1876539150134400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607680.142113:0:19178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607680.142140:0:19178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571fe00/0xa26202d240fbe6bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbe6b8 expref: 23 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607680.142155:0:19178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607680.142218:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.142227:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607680.142229:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607680.142231:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789607680.142247:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fcd69000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789607680.142294:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78fcd6d800 for lustre-MDT0000 00010000:00010000:1.0:1789607680.142413:0:20268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789607680.142421:0:20268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbe6b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe6bf expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.142480:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607680.142614:0:19178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d9246050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:3469:x1876539150134400:12345-0@lo:103:ldlm_bl.0 Request processed in 514us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607680.142623:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607680.142705:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150134400:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607680.142736:0:20268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.142744:0:20268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.142751:0:20268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.142826:0:20268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.143045:0:20268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607680.143054:0:20268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.143061:0:20268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.143067:0:20268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.143074:0:20268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.143111:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607680.143117:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.143124:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571ee00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607680.143128:0:16417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.143135:0:16417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607680.143141:0:16417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607680.143146:0:16417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789607680.143148:0:16417:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789607680.143150:0:16417:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789607680.143177:0:16417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.143183:0:16417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789607680.143228:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150134528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607680.143268:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607680.143334:0:16414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150134528 00000100:00100000:3.0:1789607680.143340:0:16414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150134528 00000100:00100000:3.0:1789607680.143376:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607680.143385:0:16414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c624b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+22:3470:x1876539150134528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607680.143395:0:16414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607680.143407:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075d000/0xa26202d240fbead2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbeacb expref: 22 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607680.143417:0:16414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607680.143463:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.143471:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571ee00/0xa26202d240fbeacb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbead2 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.143481:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607680.143491:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.143509:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075dc00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607680.143512:0:16417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.143528:0:16417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607680.143535:0:16417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607680.143541:0:16417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789607680.143543:0:16417:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789607680.143557:0:16417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.143563:0:16417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607680.144429:0:20268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1789607680.144439:0:20268:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789607680.144451:0:20268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.144461:0:20268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.144468:0:20268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.144474:0:20268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607680.144484:0:20268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789607680.144487:0:20268:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789607680.144489:0:20268:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789607680.144530:0:20268:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789607680.144534:0:20268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789607680.144539:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607680.144544:0:20268:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1789607680.144551:0:20268:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d77c5f20000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789607680.144556:0:20268:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d78c6359800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789607680.144561:0:20268:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d78d94bf000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789607680.144566:0:20268:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8d78f0407800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789607680.144571:0:20268:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8d77c4ce3380) has exports, disconnecting them 00000020:00080000:2.0:1789607680.144576:0:20268:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d77c5f20000), last request at 1789607679 00000020:00000080:2.0:1789607680.144592:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbea9a 00000100:00080000:2.0:1789607680.144609:0:20268:0:(import.c:65:import_set_state_nolock()) ffff8d77c5f26800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789607680.144659:0:20268:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d77c5f20000): rc 0 00000020:00000080:2.0:1789607680.144662:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d77c5f20000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789607680.144672:0:20268:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d78c6359800), last request at 1789607679 00000020:00000080:2.0:1789607680.144674:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe935 00000100:00080000:2.0:1789607680.144679:0:20268:0:(import.c:65:import_set_state_nolock()) ffff8d78c635d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789607680.144686:0:20268:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78c6359800): rc 0 00000020:00000080:2.0:1789607680.144688:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78c6359800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789607680.144692:0:20268:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d78d94bf000), last request at 1789607607 00000020:00000080:2.0:1789607680.144694:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe886 00000100:00080000:2.0:1789607680.144697:0:20268:0:(import.c:65:import_set_state_nolock()) ffff8d78d94bf800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789607680.144703:0:20268:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78d94bf000): rc 0 00000020:00000080:2.0:1789607680.144705:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78d94bf000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789607680.144708:0:20268:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d78f0407800), last request at 1789607607 00000020:00000080:2.0:1789607680.144711:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe81d 00000100:00080000:2.0:1789607680.144714:0:20268:0:(import.c:65:import_set_state_nolock()) ffff8d78cfc3a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789607680.144720:0:20268:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00080000:2.0:1789607680.145017:0:20268:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78f0407800): rc 0 00000004:00000080:2.0:1789607680.145024:0:20268:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa81b01cc7ae0 00000100:00080000:2.0:1789607680.145041:0:20268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789607680.145045:0:20268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789607680.145832:0:20268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789607680.145858:0:20268:0:(import.c:65:import_set_state_nolock()) ffff8d78e0e9a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789607680.145932:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150134784:0@lo:39:umount.0 00000100:00100000:2.0:1789607680.146002:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607680.148378:0:16414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c624b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:3470:x1876539150134528:12345-0@lo:103:ldlm_bl.0 Request processed in 4985us (5100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607680.148392:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789607680.148605:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.148617:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78e075dc00/0xa26202d240fbec61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbec68 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.148635:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607680.148640:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.148646:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd581800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607680.148650:0:16417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.148677:0:16417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607680.148684:0:16417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607680.148689:0:16417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789607680.148692:0:16417:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789607680.148695:0:16417:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789607680.148733:0:16417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.148739:0:16417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607680.148772:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.148780:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd581800/0xa26202d240fbe6aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe6b1 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.148791:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607680.148793:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607680.148795:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607680.148814:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150134656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607680.148890:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789607680.148941:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c5f20000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789607680.148983:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78c6359800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789607680.149010:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78d94bf000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789607680.149030:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c5f26800 for lustre-MDT0000 00000020:00000080:0.0:1789607680.149041:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78c635d800 for lustre-MDT0000 00000020:00000080:0.0:1789607680.149044:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78d94bf800 for lustre-MDT0000 00000100:00100000:0.0:1789607680.149121:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150134656 00000100:00100000:0.0:1789607680.149127:0:19178:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150134656 00000100:00100000:0.0:1789607680.149167:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607680.149176:0:19178:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7095b5c7-e12e-406f-ad0b-bb55e8b45703+21:3471:x1876539150134656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607680.149190:0:19178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607680.149205:0:19178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075c600/0xa26202d240fbec68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbec61 expref: 21 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.149220:0:19178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607680.149254:0:19178:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:3471:x1876539150134656:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607680.149261:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607680.149296:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3471:1876539150134656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607680.149315:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607680.149369:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607680.149379:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150134912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607680.149407:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607680.149472:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150134912 00000100:00100000:0.0:1789607680.149477:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150134912 00000100:00080000:2.0:1789607680.149672:0:20268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789607680.149676:0:20268:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1789607680.149697:0:20268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789607680.149755:0:20268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789607680.149770:0:20268:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789607680.149785:0:20268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789607680.149787:0:20268:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1789607680.149795:0:20268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789607680.149882:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150135040:0@lo:9:umount.0 00000100:00100000:2.0:1789607680.149914:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789607680.149944:0:20268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789607680.149953:0:20268:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789607680.149969:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150135168:0@lo:9:umount.0 00000100:00100000:2.0:1789607680.149992:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789607680.150038:0:20268:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d77c4ce3380) has no exports 00000100:00100000:0.0:1789607680.150226:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789607680.150236:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+20:3469:x1876539150134912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607680.150249:0:16415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607680.150263:0:16415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c9184200/0xa26202d240fbe6b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbe6aa expref: 20 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607680.150275:0:16415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607680.150315:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:3469:x1876539150134912:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607680.150321:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607680.150384:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150134912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607680.150450:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150134528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607680.150474:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150134784 00000100:00100000:1.0:1789607680.150478:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150134784 00000100:00100000:1.0:1789607680.150593:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789607680.150601:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3467:x1876539150134784:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789607680.150624:0:17069:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe8b0 00000100:00080000:1.0:1789607680.150631:0:17069:0:(import.c:65:import_set_state_nolock()) ffff8d78f5860800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789607680.150652:0:17069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789607680.151028:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3467:x1876539150134784:12345-0@lo:39:umount.0 Request processed in 426us (5024us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789607680.151035:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789607680.151067:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150135040 00000100:00100000:1.0:1789607680.151071:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150135040 00000100:00100000:1.0:1789607680.151101:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150135168 00000100:00100000:1.0:1789607680.151104:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150135168 00000100:00100000:1.0:1789607680.151122:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789607680.151129:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3467:x1876539150135040:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789607680.151144:0:17881:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe974 00000100:00080000:1.0:1789607680.151150:0:17881:0:(import.c:65:import_set_state_nolock()) ffff8d78c5294000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789607680.151179:0:17881:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789607680.151384:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3467:x1876539150135040:12345-0@lo:9:umount.0 Request processed in 255us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607680.151391:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789607680.151404:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607680.151410:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3467:x1876539150135168:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789607680.151422:0:17881:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbead9 00000100:00080000:1.0:1789607680.151427:0:17881:0:(import.c:65:import_set_state_nolock()) ffff8d77c10af800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789607680.151455:0:17881:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00080000:2.0:1789607680.151990:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607680.152142:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789607680.152156:0:3467:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789607680.152158:0:3467:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789607680.152162:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150135040:0@lo:9:umount.0 00000100:00080000:2.0:1789607680.152176:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e0e9a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789607680.152180:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150134784:0@lo:39:umount.0 00010000:00010000:2.0:1789607680.152219:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607680.152686:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3467:x1876539150135168:12345-0@lo:9:umount.0 Request processed in 1274us (2690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607680.152695:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789607680.152740:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f567f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789607680.152749:0:3467:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789607680.152750:0:3467:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789607680.152753:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150135168:0@lo:9:umount.0 00010000:00010000:0.0:1789607680.152952:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789607680.161896:0:20268:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8d77c4ce3380) has no exports 00000020:00000080:3.0:1789607680.203185:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe705 00000020:00000080:3.0:1789607680.203201:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78fab1e800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789607680.203219:0:20268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789607680.203403:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fab1e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789607680.203510:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607680.203530:0:20268:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789607680.203536:0:20268:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8d77c4193380) has no exports 00000020:00000080:2.0:1789607680.205493:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe6fe 00000020:00000080:2.0:1789607680.205606:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78d8afe000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789607680.205695:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78d8afe000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789607680.205811:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607680.205821:0:20268:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789607680.205825:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78d8af7800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789607680.205828:0:20268:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78d8af7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789607680.205838:0:20268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1789607680.930035:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789607681.284241:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789607681.284251:0:8140:0:(genops.c:885:class_export_put()) final put ffff8d78c5296000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789607681.284593:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78c5296000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789607681.284646:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78c5294000 for lustre-OST0000 00010000:00010000:0.0:1789607681.954836:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607682.978228:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607683.298751:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150135296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607683.298833:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607683.298979:0:19384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150135296 00000100:00100000:1.0:1789607683.298991:0:19384:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150135296 00000100:00100000:1.0:1789607683.299055:0:19384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607683.299066:0:19384:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150135296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789607683.299100:0:19384:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789607683.299369:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607683.300337:0:19384:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150135296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1268us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607683.300348:0:19384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789607683.300436:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150135296:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1789607683.838554:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789607683.838563:0:9077:0:(genops.c:885:class_export_put()) final put ffff8d77c10ae000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789607683.838640:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c10ae000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789607683.838743:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c10af800 for lustre-OST0001 00010000:00010000:0.0:1789607684.002055:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607684.322498:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607684.322520:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150135424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607684.322589:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607684.322775:0:16433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150135424 00000100:00100000:3.0:1789607684.322794:0:16433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150135424 00000100:00100000:3.0:1789607684.322834:0:16433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789607684.322841:0:16433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1876539150135424:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1789607684.322848:0:16433:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789607684.322916:0:16433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1876539150135424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (327us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789607684.322923:0:16433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:02020000:0.0:1789607684.323062:0:3471:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1789607684.335989:0:3471:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789607684.335996:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8d78fcb58800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789607684.336002:0:3471:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789607684.363393:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8d78fcb58800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607684.363408:0:3471:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1789607684.363424:0:3471:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d78fcb58800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607684.363851:0:3471:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78ff79f800 x1876539150135552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607684.363941:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150135552:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789607684.364007:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607684.364207:0:16434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150135552 00000100:00100000:2.0:1789607684.364216:0:16434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150135552 00000100:00100000:2.0:1789607684.364274:0:16434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789607684.364283:0:16434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3467:x1876539150135552:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1789607684.364300:0:16434:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789607684.375104:0:16434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3467:x1876539150135552:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 10816us (11092us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789607684.375118:0:16434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1789607684.391328:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fcb58800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607684.391341:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789607684.391346:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150135552:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789607684.836100:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150135808:0@lo:400:kworker.0 00000100:00100000:1.0:1789607684.836179:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607684.836251:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150136320:0@lo:400:kworker.0 00000100:00100000:1.0:1789607684.836277:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607684.836303:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789607684.836308:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150135936:0@lo:400:kworker.0 00000100:00100000:1.0:1789607684.836329:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607684.836351:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150136448:0@lo:400:kworker.0 00000100:00100000:1.0:1789607684.836371:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607684.836399:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150135808 00000100:00100000:1.0:1789607684.836406:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150135808 00000100:00100000:1.0:1789607684.836444:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150135936 00000100:00100000:1.0:1789607684.836447:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150135936 00000100:00100000:2.0:1789607684.836577:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150136064:0@lo:400:kworker.0 00000100:00100000:2.0:1789607684.836613:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607684.836635:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150136576:0@lo:400:kworker.0 00000100:00100000:2.0:1789607684.836656:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607684.836674:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789607684.836680:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150135680:0@lo:400:kworker.0 00000100:00100000:2.0:1789607684.836706:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607684.836740:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150136192:0@lo:400:kworker.0 00000100:00100000:2.0:1789607684.836762:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607684.836782:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150136320 00000100:00100000:2.0:1789607684.836786:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150136320 00000100:00100000:2.0:1789607684.836808:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150136448 00000100:00100000:2.0:1789607684.836811:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150136448 00000100:00100000:2.0:1789607684.836819:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150136064 00000100:00100000:2.0:1789607684.836822:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150136064 00000100:00100000:2.0:1789607684.836829:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150136576 00000100:00100000:2.0:1789607684.836831:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150136576 00000100:00100000:2.0:1789607684.836846:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150136192 00000100:00100000:2.0:1789607684.836848:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150136192 00000100:00100000:2.0:1789607684.836859:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789607684.836888:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150136320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607684.836939:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150136320:12345-0@lo:400:kworker.0 Request processed in 54us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607684.836948:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789607684.836966:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789607684.836973:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150136576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607684.837006:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150136576:12345-0@lo:400:kworker.0 Request processed in 34us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607684.837011:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789607684.837025:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789607684.837029:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3468:x1876539150136448:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789607684.837035:0:16428:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789607684.837058:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3468:x1876539150136448:12345-0@lo:400:kworker.0 Request processed in 27us (686us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789607684.837062:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789607684.837081:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789607684.837085:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3470:x1876539150136064:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789607684.837089:0:16428:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789607684.837112:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3470:x1876539150136064:12345-0@lo:400:kworker.0 Request processed in 26us (499us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789607684.837117:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789607684.837127:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789607684.837131:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3470:x1876539150136192:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789607684.837135:0:16428:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789607684.837156:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3470:x1876539150136192:12345-0@lo:400:kworker.0 Request processed in 23us (393us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789607684.837161:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789607684.837180:0:16424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150135680 00000100:00100000:2.0:1789607684.837183:0:16424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150135680 00000100:00100000:2.0:1789607684.837209:0:16424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789607684.837215:0:16424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78efaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:3470:x1876539150135680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607684.837244:0:16424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78efaf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7095b5c7-e12e-406f-ad0b-bb55e8b45703+19:3470:x1876539150135680:12345-0@lo:400:kworker.0 Request processed in 29us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607684.837250:0:16424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789607684.837290:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150135680:0@lo:400:kworker.0 00000100:00080000:2.0:1789607684.837303:0:3470:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789607684.837308:0:3470:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789607684.837311:0:3470:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789607684.837317:0:3470:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789607684.837320:0:3470:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 524 00000100:00080000:2.0:1789607684.837328:0:3470:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d77c10f0000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607684.837357:0:3470:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78c61fc700 x1876539150136704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607684.837377:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150136192:0@lo:400:kworker.0 00000100:00080000:2.0:1789607684.837389:0:3470:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789607684.837391:0:3470:0:(import.c:65:import_set_state_nolock()) ffff8d78c6359000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789607684.837394:0:3470:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789607684.837397:0:3470:0:(import.c:65:import_set_state_nolock()) ffff8d78c6359000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789607684.837399:0:3470:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 512 00000100:00080000:2.0:1789607684.837404:0:3470:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d78c6359000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607684.837416:0:3470:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78c61ff480 x1876539150136832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607684.837427:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150136064:0@lo:400:kworker.0 00010000:00080000:2.0:1789607684.837438:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8f1880 x1876539150136576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607684.837448:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150136576:0@lo:400:kworker.0 00000100:00100000:1.0:1789607684.837712:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789607684.837723:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150135808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607684.837763:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150135808:12345-0@lo:400:kworker.0 Request processed in 43us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607684.837769:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789607684.837783:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607684.837789:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150135936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607684.837816:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150135936:12345-0@lo:400:kworker.0 Request processed in 27us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607684.837821:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607684.837910:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150135936:0@lo:400:kworker.0 00000100:00080000:1.0:1789607684.837922:0:3468:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789607684.837925:0:3468:0:(import.c:65:import_set_state_nolock()) ffff8d78c635f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789607684.837928:0:3468:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789607684.837932:0:3468:0:(import.c:65:import_set_state_nolock()) ffff8d78c635f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607684.837935:0:3468:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 538 00000100:00080000:1.0:1789607684.837940:0:3468:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d78c635f800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607684.837955:0:3468:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cf7c5f80 x1876539150136960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607684.837965:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3468:1876539150136448:0@lo:400:kworker.0 00000100:00100000:1.0:1789607684.837978:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150135808:0@lo:400:kworker.0 00010000:00080000:1.0:1789607684.837986:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fa8f1180 x1876539150136320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607684.837994:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150136320:0@lo:400:kworker.0 00000100:00100000:3.0:1789607684.838158:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539150136704:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789607684.838191:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607684.838212:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3467:1876539150136832:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789607684.838233:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607684.838249:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150136960:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789607684.838268:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607684.838299:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150136704 00000100:00100000:3.0:1789607684.838304:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150136704 00000100:00100000:3.0:1789607684.838324:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150136832 00000100:00100000:3.0:1789607684.838327:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150136832 00000100:00100000:3.0:1789607684.838334:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150136960 00000100:00100000:3.0:1789607684.838336:0:16428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150136960 00000100:00100000:3.0:1789607684.838345:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789607684.838349:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539150136704:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1789607684.838362:0:16428:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789607684.838393:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539150136704:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 43us (202us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789607684.838398:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789607684.838410:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789607684.838414:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539150136832:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1789607684.838430:0:16428:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789607684.838478:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539150136832:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 62us (244us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789607684.838494:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789607684.838507:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789607684.838511:0:16428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539150136960:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1789607684.838518:0:16428:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789607684.838540:0:16428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539150136960:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 28us (272us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789607684.838546:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1789607684.838569:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607684.838573:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789607684.838576:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539150136704:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1789607684.838583:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c6359000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607684.838587:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789607684.838589:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3467:1876539150136832:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1789607684.838596:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c635f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607684.838598:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789607684.838601:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150136960:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1789607684.839160:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607684.839165:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607684.839189:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150137088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607684.839228:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607684.839279:0:17742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150137088 00000100:00100000:0.0:1789607684.839285:0:17742:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150137088 00000100:00100000:0.0:1789607684.839317:0:17742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789607684.839332:0:17742:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150137088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789607684.839360:0:17742:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607684.839397:0:17742:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150137088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607684.839402:0:17742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789607684.839446:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150137088:0@lo:13:osp-pre-1-1.0 00000001:00100000:2.0:1789607684.882909:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789607684.882925:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1789607684.882931:0:7270:0:(genops.c:885:class_export_put()) final put ffff8d78f5863800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789607684.882955:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f5863800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1789607684.883007:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78f5860800 for lustre-MDT0001 00000001:00100000:3.0:1789607684.887956:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789607684.887965:0:6490:0:(genops.c:885:class_export_put()) final put ffff8d78f0407800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789607684.888024:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f0407800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789607684.888080:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78cfc3a800 for lustre-MDT0000 00010000:00010000:2.0:1789607685.026769:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607686.050693:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789607686.241997:0:20268:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78e9ceef00 - data ffff8d78f0c60e58/ffff8d77c65e7c00 00000020:01000000:2.0:1789607686.242130:0:20268:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78f77fe720 - data ffff8d78d1327e58/ffff8d78f5809400 00000001:00000004:2.0:1789607686.249291:0:20268:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:2.0:1789607686.314003:0:20268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789607686.314012:0:20268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789607686.314027:0:20268:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8d78c61fea00 x1876539150134784/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789607690 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607686.314057:0:20268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789607686.319333:0:20268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789607686.319340:0:20268:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789607686.319402:0:20268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789607686.319405:0:20268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789607686.320027:0:16452:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789607686.320032:0:16452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1789607686.320043:0:16452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789607686.322654:0:20268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789607686.322660:0:20268:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1789607686.322678:0:20268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789607686.322681:0:20268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789607686.324343:0:16454:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789607686.324350:0:16454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1789607686.324361:0:16454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1789607686.375596:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe6cd 00000020:00000080:3.0:1789607686.375609:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78d945b800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789607686.376271:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe6e2 00000020:00000080:3.0:1789607686.376279:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78c7d21800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789607686.376285:0:20268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789607686.376302:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607686.376311:0:20268:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789607686.376315:0:20268:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8d77c4ce19c0) has no exports 00000004:01000000:3.0:1789607686.376457:0:20268:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789607686.376465:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe744 00000020:00000080:3.0:1789607686.376469:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78d9432000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789607686.376486:0:20268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789607686.376490:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607686.376494:0:20268:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789607686.376497:0:20268:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8d78ef1619c0) has no exports 00000020:00000080:3.0:1789607686.376502:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe73d 00000020:00000080:3.0:1789607686.376505:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78f5679800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789607686.376817:0:20268:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789607686.376822:0:20268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789607686.376826:0:20268:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1789607686.376832:0:20268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789607686.376834:0:20268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789607686.376888:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607686.376895:0:20268:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789607686.376900:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe72f 00000020:00000080:3.0:1789607686.376905:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78d9430800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789607686.376909:0:20268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789607686.376913:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607686.376915:0:20268:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789607686.376918:0:20268:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8d78ef164d40) has no exports 00000020:00000080:3.0:1789607686.376921:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe728 00000020:00000080:3.0:1789607686.376923:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78f5678000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789607686.377233:0:20268:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789607686.377236:0:20268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789607686.377238:0:20268:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789607686.377242:0:20268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789607686.377243:0:20268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789607686.377271:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607686.377276:0:20268:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789607686.377284:0:20268:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789607686.377290:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe71a 00000020:00000080:3.0:1789607686.377294:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78f5678800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789607686.377297:0:20268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789607686.377300:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607686.377303:0:20268:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789607686.377305:0:20268:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff8d78fd3f19c0) has no exports 00000020:00000080:3.0:1789607686.377308:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe713 00000020:00000080:3.0:1789607686.377310:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78e0e98800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789607686.378273:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78d945b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789607686.378285:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78c7d21800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789607686.378290:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78d9432000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789607686.378294:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f5679800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789607686.378299:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78f567f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789607686.378305:0:38:0:(genops.c:885:class_export_put()) final put ffff8d78d9436800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789607686.378307:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78d9436800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789607686.378311:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789607686.378383:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78d9430800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789607686.378390:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f5678000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789607686.378394:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78f567f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789607686.378398:0:38:0:(genops.c:885:class_export_put()) final put ffff8d78f567e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789607686.378408:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f567e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789607686.378412:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789607686.378437:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f5678800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789607686.378442:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e0e98800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789607686.380080:0:20268:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1789607686.380087:0:20268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789607686.380338:0:20268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789607686.380346:0:20268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789607686.380520:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607686.380531:0:20268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789607686.380560:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607686.380563:0:20268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789607686.380569:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78f5616000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789607686.380573:0:20268:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f5616000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789607686.380579:0:20268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789607686.380661:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe6e9 00000020:00000080:3.0:1789607686.380668:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78c7d26000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789607686.382070:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78e0e9a000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789607686.382085:0:38:0:(genops.c:885:class_export_put()) final put ffff8d78d945c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789607686.382670:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78d945c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1789607686.382686:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789607686.383010:0:20268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789607686.383018:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607686.383026:0:20268:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789607686.383041:0:20268:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8d77c4ce0000) has no exports 00000020:00000080:3.0:1789607686.383073:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607686.383079:0:20268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789607686.383085:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe6f0 00000020:00000080:3.0:1789607686.383092:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78c7d20000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789607686.383111:0:20268:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d77c419c000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789607686.383114:0:20268:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d77c419c000 3 00000020:01000004:3.0:1789607686.383117:0:20268:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d77c419c000 from lustre-MDT0000 00000020:00000080:3.0:1789607686.383140:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607686.383144:0:20268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789607686.383147:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78d9459000/lustre-MDT0000_UUID 00000020:00000080:3.0:1789607686.383149:0:20268:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78d9459000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789607686.383157:0:20268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789607686.383197:0:20268:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1789607686.383201:0:20268:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789607686.383203:0:20268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789607686.383206:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607686.383209:0:20268:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789607686.383216:0:20268:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8d78e0a2c000 7095b5c7-e12e-406f-ad0b-bb55e8b45703 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789607686.383222:0:20268:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8d77c4ce4d40) has exports, disconnecting them 00000020:00080000:3.0:1789607686.383226:0:20268:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d78e0a2c000), last request at 1789607595 00000020:00000080:3.0:1789607686.383242:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe695 00000020:00010000:3.0:1789607686.383245:0:20268:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8d78e0a2c000: total 2 00000100:00080000:3.0:1789607686.383250:0:20268:0:(import.c:65:import_set_state_nolock()) ffff8d78e0a28000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789607686.383308:0:20268:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78e0a2c000): rc 0 00000020:00080000:3.0:1789607686.383313:0:20268:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8d77c4ce4d40) has no exports 00000100:00100000:3.0:1789607686.383364:0:16423:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d78d9426c00:16423] 1 exiting: rc = 0 00000100:00100000:3.0:1789607686.383443:0:16424:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d78f62e0000:16424] 2 exiting: rc = 0 00000020:00000080:0.0:1789607686.383538:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78c7d26000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789607686.383543:0:38:0:(genops.c:885:class_export_put()) final put ffff8d79013bc000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789607686.383545:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d79013bc000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789607686.383549:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789607686.383579:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78c7d20000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1789607686.385405:0:16421:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d78e0b15400:16421] 0 exiting: rc = 1 00000100:00100000:3.0:1789607686.385583:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385592:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385598:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385603:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385609:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385616:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385621:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385627:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385652:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385657:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385663:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385670:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385675:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385679:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385684:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385689:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385694:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385698:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385703:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385707:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385712:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385717:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385721:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385726:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385730:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385735:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385740:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385745:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385749:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385755:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385759:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385764:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385769:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385774:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385779:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385785:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385790:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385795:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385802:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385807:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385813:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385819:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385823:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385836:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385840:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385846:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385851:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.385856:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386154:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386162:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386167:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386172:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386177:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386182:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386186:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386191:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386196:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386201:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386205:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386210:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386214:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386219:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386224:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607686.386230:0:20268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1789607686.389762:0:20268:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789607686.389769:0:20268:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:3.0:1789607686.390213:0:20268:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78fd580c00/0xa26202d240fbe7b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbe7ad expref: 14 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390235:0:20268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd580c00/0xa26202d240fbe7b4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbe7ad expref: 14 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390251:0:20268:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78c9185000/0xa26202d240fbe6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbe69c expref: 13 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390261:0:20268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c9185000/0xa26202d240fbe6a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbe69c expref: 13 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390284:0:20268:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78fd581200/0xa26202d240fbe7d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbe7c9 expref: 12 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390293:0:20268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd581200/0xa26202d240fbe7d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbe7c9 expref: 12 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390301:0:20268:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d77c571f400/0xa26202d240fbe871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbe86a expref: 11 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390310:0:20268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571f400/0xa26202d240fbe871 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbe86a expref: 11 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390320:0:20268:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d77c571ea00/0xa26202d240fbe8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbe8ef expref: 10 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390328:0:20268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571ea00/0xa26202d240fbe8f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbe8ef expref: 10 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390336:0:20268:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78fd581000/0xa26202d240fbe920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbe919 expref: 9 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390344:0:20268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd581000/0xa26202d240fbe920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbe919 expref: 9 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390352:0:20268:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d77c571f200/0xa26202d240fbea5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbea54 expref: 8 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390359:0:20268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571f200/0xa26202d240fbea5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbea54 expref: 8 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390377:0:20268:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbea85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbea7e expref: 7 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390386:0:20268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571ec00/0xa26202d240fbea85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbea7e expref: 7 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390398:0:20268:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d78e075ca00/0xa26202d240fbeac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbeabd expref: 6 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390406:0:20268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78e075ca00/0xa26202d240fbeac4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbeabd expref: 6 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390417:0:20268:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbe7bb expref: 5 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390424:0:20268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbe7c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbe7bb expref: 5 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390434:0:20268:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d77c571e800/0xa26202d240fbec3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbec37 expref: 4 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390442:0:20268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571e800/0xa26202d240fbec3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbec37 expref: 4 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607686.390448:0:20268:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8d77c571e200/0xa26202d240fbec4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xa26202d240fbec45 expref: 3 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1789607686.390562:0:16417:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8d78e0a2c000: total 0 00010000:00010000:2.0:1789607686.390567:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607686.390610:0:16417:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d78e0a2c000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789607686.390629:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbec5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa26202d240fbec53 expref: 3 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607686.390641:0:16417:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d78e0a2c000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789607686.390654:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607686.390655:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607686.390657:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607686.391126:0:20268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77c571e200/0xa26202d240fbec4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xa26202d240fbec45 expref: 1 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789607686.391142:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d78e0a2c000/7095b5c7-e12e-406f-ad0b-bb55e8b45703 00000020:00000080:2.0:1789607686.391352:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e0a2c000/7095b5c7-e12e-406f-ad0b-bb55e8b45703 for MGS 00000020:00000080:2.0:1789607686.391389:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78e0a28000 for MGS 00000020:01000000:3.0:1789607686.391932:0:20268:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78e9cee420 - data ffff8d78d0b2b6c0/ffff8d77c445d800 00000020:01000000:3.0:1789607686.392110:0:20268:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78c7563660 - data ffff8d78f1747438/ffff8d790030d000 00000020:00000080:3.0:1789607686.392614:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe679 00000020:00000080:3.0:1789607686.392622:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d77c610b000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789607686.392680:0:20268:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d77c419c000 from MGS, refs=2 00000020:01000004:3.0:1789607686.392684:0:20268:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d77c419c000 2 00000020:01000004:3.0:1789607686.392687:0:20268:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d77c419c000 from MGS 00000020:00000080:3.0:1789607686.392712:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607686.392717:0:20268:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789607686.392720:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d77c6109000/MGS 00000020:00000080:3.0:1789607686.392723:0:20268:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c6109000/MGS for MGS 00000020:01000000:3.0:1789607686.392727:0:20268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789607686.392772:0:20268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789607686.392776:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607686.392782:0:20268:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789607686.392787:0:20268:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d7900377800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789607686.392792:0:20268:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8d78f12b0000) has exports, disconnecting them 00000020:00080000:3.0:1789607686.392797:0:20268:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d7900377800), last request at 1789607596 00000020:00000080:3.0:1789607686.392801:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe77c 00000020:00080000:3.0:1789607686.392807:0:20268:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d7900377800): rc 0 00000020:00000080:3.0:1789607686.392810:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d7900377800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789607686.392837:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c610b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789607686.393273:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7900377800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789607686.395553:0:20268:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789607686.395562:0:20268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789607686.395566:0:20268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789607686.395573:0:20268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789607686.395809:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607686.395817:0:20268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789607686.395824:0:20268:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d77c419c000 1 00000020:00000080:2.0:1789607686.395830:0:20268:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe66b 00000020:00000080:2.0:1789607686.395838:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d77c610f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789607686.395858:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d7900371800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789607686.395889:0:36:0:(genops.c:885:class_export_put()) final put ffff8d7900375000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789607686.395892:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7900375000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789607686.395897:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1789607686.396169:0:20268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789607686.396175:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607686.396189:0:20268:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789607686.396194:0:20268:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8d78f12b19c0) has no exports 00000020:00000080:0.0:1789607686.397383:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c610f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789607686.413547:0:20268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607686.413561:0:20268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789607686.413567:0:20268:0:(genops.c:885:class_export_put()) final put ffff8d77c419a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789607686.413579:0:20268:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c419a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789607686.413586:0:20268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789607686.413780:0:20268:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d77c419e000 00000020:02000400:0.0:1789607686.413999:0:20268:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789607687.074370:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607688.101508:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607688.422409:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150137216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607688.422486:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607688.423050:0:19384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150137216 00000100:00100000:1.0:1789607688.423059:0:19384:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150137216 00000100:00080000:3.0:1789607688.423097:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607688.423174:0:19384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607688.423186:0:19384:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150137216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607688.423221:0:19384:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607688.423282:0:19384:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150137216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607688.423302:0:19384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789607688.423453:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150137216:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1789607688.781332:0:20423:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789607688.791346:0:20423:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1789607688.791397:0:20423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.791413:0:20423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.791420:0:20423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.791504:0:20423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.791531:0:20423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789607688.791536:0:20423:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789607688.791557:0:20423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607688.791562:0:20423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789607688.791568:0:20423:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789607688.791574:0:20423:0:(import.c:65:import_set_state_nolock()) ffff8d78c6359000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789607688.791579:0:20423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607688.791581:0:20423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789607688.791598:0:20423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789607688.792201:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607688.792210:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607688.792219:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607688.792224:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607688.792234:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607688.792242:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607688.792248:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789607688.792251:0:16418:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789607688.792254:0:16418:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789607688.792292:0:16418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607688.792299:0:16418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607688.792322:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607688.792329:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbe86a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe871 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607688.792343:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607688.792353:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607688.792355:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607688.792374:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150137344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607688.792434:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607688.792513:0:16416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150137344 00000100:00100000:3.0:1789607688.792519:0:16416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150137344 00000100:00100000:3.0:1789607688.792551:0:16416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607688.792558:0:16416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3469:x1876539150137344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789607688.792565:0:16416:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789607688 with bad export cookie 11700917883918608021 00010000:00010000:0.0:1789607688.793206:0:20423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793218:0:20423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793225:0:20423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793231:0:20423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793248:0:20423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607688.793260:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607688.793266:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793273:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f000 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607688.793276:0:16417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793284:0:16417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607688.793291:0:16417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607688.793297:0:16417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789607688.793300:0:16417:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789607688.793326:0:16417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793341:0:16417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607688.793366:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793373:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571f000/0xa26202d240fbe7c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe7d0 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793385:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607688.793387:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607688.793389:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607688.793400:0:20423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793408:0:20423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793414:0:20423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793420:0:20423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793432:0:20423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607688.793447:0:20423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793453:0:20423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793477:0:20423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793484:0:20423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793496:0:20423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789607688.793503:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607688.793507:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793512:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571f600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607688.793515:0:16417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793522:0:16417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607688.793528:0:16417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607688.793533:0:16417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789607688.793535:0:16417:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789607688.793538:0:16417:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789607688.793553:0:16417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793559:0:16417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607688.793565:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793577:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571f600/0xa26202d240fbeabd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbeac4 expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793589:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607688.793592:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793598:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580a00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607688.793601:0:16417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793608:0:16417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607688.793613:0:16417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607688.793618:0:16417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789607688.793620:0:16417:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789607688.793622:0:16417:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789607688.793637:0:16417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793643:0:16417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607688.793656:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793662:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd580a00/0xa26202d240fbec53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbec5a expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793681:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607688.793682:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607688.793684:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607688.793695:0:20423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793702:0:20423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793708:0:20423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793714:0:20423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793726:0:20423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789607688.793728:0:20423:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1789607688.793733:0:20423:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1789607688.793751:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607688.793755:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793760:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571e600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607688.793763:0:16417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793769:0:16417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607688.793786:0:16417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607688.793791:0:16417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789607688.793793:0:16417:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789607688.793795:0:16417:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789607688.793808:0:16417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793813:0:16417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607688.793825:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793831:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571e600/0xa26202d240fbe7bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa26202d240fbe7c2 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607688.793841:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607688.793843:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607688.793844:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789607688.793855:0:20423:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1789607688.793858:0:20423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1789607688.793878:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607688.793883:0:20423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1789607688.793889:0:20423:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8d77c10f1800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789607688.793895:0:20423:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8d77c10f6800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789607688.793899:0:20423:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8d78f12b4d40) has exports, disconnecting them 00000020:00080000:0.0:1789607688.793904:0:20423:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d77c10f1800), last request at 1789607684 00000020:00000080:0.0:1789607688.793909:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbeaaf 00000100:00080000:0.0:1789607688.793922:0:20423:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f5800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789607688.793955:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789607688.793964:0:20423:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d77c10f1800): rc 0 00000020:00000080:0.0:1789607688.793967:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d77c10f1800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1789607688.793974:0:20423:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d77c10f6800), last request at 1789607684 00000020:00000080:0.0:1789607688.793977:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe94a 00000100:00080000:0.0:1789607688.793985:0:20423:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f2800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1789607688.793994:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c10f1800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1789607688.794059:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c10f5800 for lustre-MDT0001 00010000:00010000:0.0:1789607688.794069:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789607688.794075:0:20423:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d77c10f6800): rc 0 00000020:00000080:0.0:1789607688.794077:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d77c10f6800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1789607688.794086:0:20423:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa81b01d1fae0 00000020:00000080:0.0:1789607688.794094:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c10f6800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789607688.794122:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c10f2800 for lustre-MDT0001 00000100:00080000:0.0:1789607688.794137:0:20423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607688.794145:0:20423:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8d78c6249180 x1876539150135424/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789607700 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607688.794155:0:20423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789607688.796669:0:20423:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789607688.796681:0:20423:0:(import.c:65:import_set_state_nolock()) ffff8d78fcb58800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789607688.797003:0:20423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789607688.797008:0:20423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1789607688.797025:0:20423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789607688.797089:0:20423:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789607688.797112:0:20423:0:(import.c:65:import_set_state_nolock()) ffff8d78fcb5f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789607688.797128:0:20423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789607688.797130:0:20423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1789607688.797137:0:20423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789607688.797207:0:20423:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789607688.797220:0:20423:0:(import.c:65:import_set_state_nolock()) ffff8d78e0099000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789607688.797248:0:20423:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8d78f12b4d40) has no exports 00000100:00100000:2.0:1789607688.798555:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150137472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607688.798626:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607688.799241:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607688.799250:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150137600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607688.799280:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607688.799321:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150135424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607688.799496:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150137472 00000100:00100000:0.0:1789607688.799507:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150137472 00000100:00100000:0.0:1789607688.799541:0:16415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150137600 00000100:00100000:0.0:1789607688.799544:0:16415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150137600 00000100:00100000:0.0:1789607688.799558:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607688.799566:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3470:x1876539150137472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789607688.799572:0:16415:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789607688 with bad export cookie 11700917883918608021 00000100:00100000:0.0:1789607688.799634:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3470:x1876539150137472:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1006us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789607688.799641:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607688.799658:0:16415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607688.799662:0:16415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3470:x1876539150137600:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789607688.799667:0:16415:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789607688 with bad export cookie 11700917883918608021 00000100:00080000:2.0:1789607688.799794:0:3470:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789607688.799799:0:3470:0:(import.c:65:import_set_state_nolock()) ffff8d79013bc800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789607688.799803:0:3470:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1789607688.801657:0:16415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3470:x1876539150137600:12345-0@lo:103:ldlm_bl.0 Request processed in 1985us (2368us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789607688.801669:0:16415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789607688.803814:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150137984:0@lo:9:umount.0 00000100:00100000:3.0:1789607688.803915:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607688.803953:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150138112:0@lo:9:umount.0 00000100:00100000:3.0:1789607688.803973:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607688.804559:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150137984 00000100:00100000:1.0:1789607688.804569:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150137984 00000100:00100000:1.0:1789607688.804620:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150138112 00000100:00100000:1.0:1789607688.804623:0:17881:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150138112 00000100:00100000:1.0:1789607688.804655:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789607688.804676:0:17881:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3467:x1876539150137984:12345-0@lo:9:umount.0 00000100:00100000:0.0:1789607688.804680:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789607688.804692:0:17740:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3467:x1876539150138112:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789607688.804705:0:17881:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbea3f 00000020:00000080:0.0:1789607688.804710:0:17740:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbeae0 00000100:00080000:1.0:1789607688.804716:0:17881:0:(import.c:65:import_set_state_nolock()) ffff8d78f5864800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1789607688.804719:0:17740:0:(import.c:65:import_set_state_nolock()) ffff8d77c10ad000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789607688.804760:0:17881:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000001:00000004:0.0:1789607688.804762:0:17740:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1789607688.805311:0:17881:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3467:x1876539150137984:12345-0@lo:9:umount.0 Request processed in 636us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607688.805318:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789607688.805353:0:16425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789607688.805365:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607688.807049:0:17740:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3467:x1876539150138112:12345-0@lo:9:umount.0 Request processed in 2351us (3066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607688.807061:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1789607688.810122:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fcb5f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789607688.810140:0:3467:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789607688.810142:0:3467:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789607688.810147:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150137984:0@lo:9:umount.0 00000100:00080000:1.0:1789607688.810171:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e0099000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789607688.810183:0:3467:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789607688.810184:0:3467:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789607688.810186:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150138112:0@lo:9:umount.0 00010000:00010000:1.0:1789607688.819965:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607688.822047:0:16416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3469:x1876539150137344:12345-0@lo:103:ldlm_bl.0 Request processed in 29475us (29601us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789607688.822065:0:16416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789607688.823830:0:3470:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.125@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789607688.823835:0:3470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789607688.823845:0:3470:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d790133f100 x1876539150137344/t0(0) o103->MGC192.168.203.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789607704 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607688.823890:0:3470:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78ff79df80 x1876539150137472/t0(0) o103->MGC192.168.203.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789607704 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607688.823900:0:3470:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78ff79c700 x1876539150137600/t0(0) o103->MGC192.168.203.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789607704 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789607688.823912:0:3470:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789607688.823915:0:3470:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789607688.823916:0:3470:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789607688.823921:0:3470:0:(import.c:65:import_set_state_nolock()) ffff8d79013bc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789607688.823925:0:3470:0:(import.c:545:import_select_connection()) MGC192.168.203.125@tcp: connect to NID 0@lo last attempt 500 00000100:00080000:2.0:1789607688.823940:0:3470:0:(import.c:666:import_select_connection()) MGC192.168.203.125@tcp: import ffff8d79013bc800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607688.823974:0:3470:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78c61fd500 x1876539150138240/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607688.824018:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:0:1876539150137856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607688.824050:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3469:1876539150137344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607688.824056:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3467:1876539150138240:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1789607688.824099:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876539150138240 offset 0 length 520: 4 00000100:00100000:2.0:1789607688.824273:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150137600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607688.824278:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3470:1876539150137472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607688.824792:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7095b5c7-e12e-406f-ad0b-bb55e8b45703:0:1876539150137728:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789607688.834495:0:20423:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8d78f12b4d40) has no exports 00000020:01000000:1.0:1789607688.880231:0:20423:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d7900a68a20 - data ffff8d78d0ad10d8/ffff8d77c6630000 00000020:01000000:1.0:1789607688.880472:0:20423:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78f62a2180 - data ffff8d78f17f5870/ffff8d78c5058000 00000001:00000004:1.0:1789607688.889970:0:20423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1789607688.948116:0:20423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789607688.948125:0:20423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789607688.948132:0:20423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789607688.950158:0:20423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789607688.950165:0:20423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1789607688.950180:0:20423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789607688.950183:0:20423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789607688.951490:0:17070:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789607688.951496:0:17070:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1789607688.951520:0:17070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1789607688.952467:0:20423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789607688.952473:0:20423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1789607688.952485:0:20423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789607688.952488:0:20423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789607688.953753:0:17072:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789607688.953759:0:17072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1789607688.953768:0:17072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000001:00100000:1.0:1789607688.964059:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789607688.964076:0:9077:0:(genops.c:885:class_export_put()) final put ffff8d77c10ab000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789607688.964527:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c10ab000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789607688.964568:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c10ad000 for lustre-OST0001 00000020:00000080:2.0:1789607689.003809:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe7de 00000020:00000080:2.0:1789607689.003822:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78fd167800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789607689.003852:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fd167800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789607689.004894:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe7f3 00000020:00000080:2.0:1789607689.004904:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78e09c6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789607689.004916:0:20423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1789607689.004930:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e09c6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1789607689.008033:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607689.008085:0:20423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789607689.008093:0:20423:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8d78f12b3380) has no exports 00000004:01000000:0.0:1789607689.008260:0:20423:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789607689.008270:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe847 00000020:00000080:0.0:1789607689.008278:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78e009d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789607689.008303:0:20423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789607689.008308:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607689.008314:0:20423:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789607689.008317:0:20423:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8d78c5b93380) has no exports 00000020:00000080:0.0:1789607689.008323:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe840 00000020:00000080:0.0:1789607689.008327:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78e009e800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1789607689.008838:0:20423:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789607689.008844:0:20423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789607689.008848:0:20423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1789607689.008853:0:20423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789607689.008855:0:20423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789607689.008919:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607689.008926:0:20423:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789607689.008932:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe832 00000020:00000080:0.0:1789607689.008947:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78e009a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789607689.008952:0:20423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789607689.008955:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607689.008958:0:20423:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789607689.008961:0:20423:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8d78ef160000) has no exports 00000020:00000080:0.0:1789607689.008965:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe82b 00000020:00000080:0.0:1789607689.008968:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78fcb5c000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1789607689.009272:0:20423:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789607689.009275:0:20423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789607689.009278:0:20423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1789607689.009282:0:20423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789607689.009284:0:20423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789607689.009307:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607689.009311:0:20423:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1789607689.009321:0:20423:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789607689.009326:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe816 00000020:00000080:0.0:1789607689.009330:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78c75d5800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789607689.009333:0:20423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1789607689.009337:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607689.009340:0:20423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789607689.009342:0:20423:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8d77c4190000) has no exports 00000020:00000080:0.0:1789607689.009345:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe80f 00000020:00000080:0.0:1789607689.009348:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78fcb5d800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789607689.010471:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e009d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789607689.010485:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e009e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789607689.010501:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78e0099000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789607689.010508:0:8:0:(genops.c:885:class_export_put()) final put ffff8d78e009c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789607689.010510:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e009c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1789607689.010514:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789607689.010602:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78e009a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1789607689.010620:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fcb5c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789607689.010624:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78fcb5f800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1789607689.010629:0:8:0:(genops.c:885:class_export_put()) final put ffff8d78c75d7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789607689.010631:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78c75d7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1789607689.010634:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789607689.010659:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78c75d5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789607689.010664:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fcb5d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789607689.011734:0:20423:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1789607689.011740:0:20423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789607689.011744:0:20423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789607689.011750:0:20423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789607689.011780:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78fcb58800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789607689.011841:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607689.011854:0:20423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789607689.011858:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78f5610000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789607689.011876:0:20423:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f5610000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1789607689.011886:0:20423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789607689.012016:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607689.012021:0:20423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789607689.012026:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78cffbd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789607689.012028:0:20423:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78cffbd800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1789607689.012032:0:20423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789607689.012124:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe7fa 00000020:00000080:2.0:1789607689.012131:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78fd166000/lustre-MDD0001_UUID 00000020:01000000:2.0:1789607689.012141:0:20423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1789607689.012148:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fd166000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1789607689.012159:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607689.012164:0:20423:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789607689.012178:0:20423:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8d78f9d28000) has no exports 00000020:00000080:1.0:1789607689.013293:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607689.013302:0:20423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1789607689.013307:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78fd164800/lustre-MDD0001_UUID 00000020:00000080:1.0:1789607689.013309:0:20423:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fd164800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789607689.013319:0:20423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789607689.013486:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe801 00000020:00000080:1.0:1789607689.013493:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78fd162800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1789607689.013511:0:20423:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78d9435000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1789607689.013515:0:20423:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78d9435000 2 00000020:01000004:1.0:1789607689.013517:0:20423:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d78d9435000 from lustre-MDT0001 00000020:00000080:1.0:1789607689.013537:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607689.013540:0:20423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1789607689.013542:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78fd161000/lustre-MDT0001_UUID 00000020:00000080:1.0:1789607689.013544:0:20423:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fd161000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1789607689.013550:0:20423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1789607689.013571:0:20423:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1789607689.013575:0:20423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1789607689.013578:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607689.013581:0:20423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789607689.013587:0:20423:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8d78c6358000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789607689.013591:0:20423:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8d78fd3f4d40) has exports, disconnecting them 00000020:00080000:1.0:1789607689.013595:0:20423:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8d78c6358000), last request at 1789607607 00000020:00000080:1.0:1789607689.013599:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe87f 00000020:00080000:1.0:1789607689.013609:0:20423:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78c6358000): rc 0 00000020:00000080:1.0:1789607689.013613:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78c6358000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789607689.013742:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fd162800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789607689.013749:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78c6358000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1789607689.019079:0:20423:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1789607689.019091:0:20423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789607689.019096:0:20423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789607689.019103:0:20423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789607689.019133:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78c6359000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789607689.019325:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607689.019332:0:20423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1789607689.019338:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d7901035000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1789607689.019341:0:20423:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7901035000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1789607689.019349:0:20423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1789607689.019401:0:20423:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78d9435000 1 00000020:00000080:2.0:1789607689.019410:0:20423:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe7a6 00000020:00000080:2.0:1789607689.019416:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78cffbb000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1789607689.019425:0:20423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1789607689.019432:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78cffbb000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789607689.019440:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607689.019446:0:20423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789607689.019449:0:20423:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8d78ef163380) has no exports 00000020:00000080:2.0:1789607689.065021:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607689.065036:0:20423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789607689.065042:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d78f567a800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789607689.065046:0:20423:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f567a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789607689.065052:0:20423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789607689.065186:0:20423:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d78d9436000 00000020:01000000:2.0:1789607689.065206:0:20423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789607689.065210:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607689.065214:0:20423:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789607689.065226:0:20423:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8d78fd3f0000) has no exports 00000100:00100000:0.0:1789607689.065615:0:16428:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8d77c3befe00:16428] 0 exiting: rc = 1 00000100:00100000:0.0:1789607689.065714:0:16430:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8d78c70f9c00:16430] 2 exiting: rc = 0 00000100:00100000:3.0:1789607689.065835:0:16429:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8d77c3bef800:16429] 1 exiting: rc = 0 00000100:00100000:3.0:1789607689.066136:0:17627:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8d78cfc31800:17627] 3 exiting: rc = 0 00000100:00100000:0.0:1789607689.066510:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066520:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066527:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066533:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066539:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066545:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066551:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066557:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066572:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066579:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066585:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066592:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066598:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066603:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066610:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066615:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066687:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066698:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066705:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066715:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066726:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066737:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066747:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066757:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066766:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066777:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066787:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066797:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066807:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066818:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066825:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066836:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066849:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066858:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066885:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066895:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066904:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066913:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066921:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066931:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066941:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066952:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066961:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066981:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.066993:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067000:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067011:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067021:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067032:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067041:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067051:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067061:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067073:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067082:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067093:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067100:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067104:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067109:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067114:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067118:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067123:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067128:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067133:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.067137:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.071651:0:16432:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d78c70f8e00:16432] 1 exiting: rc = 0 00000100:00100000:0.0:1789607689.071830:0:16431:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d78c70f8200:16431] 0 exiting: rc = 1 00000100:00100000:1.0:1789607689.071902:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071912:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071918:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071924:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071931:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071947:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071953:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071957:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071960:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071963:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071967:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071971:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071974:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071977:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071979:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071983:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071986:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071989:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071992:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.071995:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072000:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072004:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072011:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072019:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072026:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072032:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072039:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072046:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072052:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072059:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072066:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072072:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072077:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072081:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072085:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072090:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072095:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072109:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072114:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072118:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072129:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072133:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072138:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072150:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072159:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072165:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072174:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072183:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072187:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072190:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072193:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072200:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072206:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072209:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072212:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072215:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072218:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072222:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072226:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072232:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072237:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072246:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072251:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.072256:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.072930:0:16433:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8d78c3a7e600:16433] 0 exiting: rc = 1 00000100:00100000:2.0:1789607689.072992:0:16434:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8d77c5ba1000:16434] 1 exiting: rc = 0 00000100:00100000:0.0:1789607689.073081:0:17069:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8d77c3b38c00:17069] 2 exiting: rc = 0 00000100:00100000:1.0:1789607689.073190:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073198:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073206:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073214:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073222:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073229:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073237:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073254:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073263:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073270:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073276:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073292:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073300:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073308:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073316:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073324:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073331:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073340:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073348:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073379:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073386:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073391:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073397:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073403:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073409:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073420:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073425:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073497:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073505:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073513:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073521:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073550:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073558:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073564:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073576:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073584:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073592:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073599:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073607:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073615:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073622:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073627:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073632:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073715:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073725:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073730:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073744:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073750:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073755:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073760:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073767:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073772:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073777:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073791:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073798:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073805:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073810:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073817:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073822:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073828:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073833:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073842:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073851:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.073892:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.085525:0:16436:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d78c8107600:16436] 1 exiting: rc = 0 00000100:00100000:0.0:1789607689.085528:0:16435:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d78c8107e00:16435] 0 exiting: rc = 1 00000100:00100000:2.0:1789607689.086015:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086023:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086030:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086036:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086043:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086050:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086056:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086062:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086069:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086074:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086080:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086085:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086091:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086108:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086115:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086122:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086129:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086134:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086141:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086147:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086153:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086159:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086165:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086174:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086185:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086194:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086204:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086208:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086213:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086228:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086234:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086240:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086245:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086249:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086255:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086260:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086266:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086271:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086276:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086281:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086286:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086296:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086442:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086449:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086464:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086471:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086482:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086491:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086499:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086506:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086513:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086518:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086524:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086529:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086534:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086540:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086544:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086549:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086593:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086603:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086610:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086618:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086623:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.086628:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.087322:0:16438:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d78faae5400:16438] 1 exiting: rc = 0 00000100:00100000:0.0:1789607689.087330:0:16437:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d78c8107800:16437] 0 exiting: rc = 1 00000100:00100000:2.0:1789607689.087427:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087435:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087443:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087451:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087470:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087477:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087485:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087492:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087499:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087507:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087514:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087521:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087529:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087535:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087542:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087549:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087556:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087561:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087568:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087575:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087583:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087589:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087596:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087604:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087618:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087626:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087631:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087636:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087969:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087979:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087985:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087991:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.087998:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088006:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088016:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088032:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088303:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088313:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088322:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088333:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088353:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088358:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088363:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088369:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088374:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088380:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088385:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088413:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088419:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088424:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088429:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088434:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088440:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088444:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088449:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088463:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088469:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088474:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088480:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088485:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088489:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088493:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088498:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.088504:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607689.088954:0:16440:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d78d92f3600:16440] 1 exiting: rc = 0 00000100:00100000:0.0:1789607689.090023:0:16439:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d78faae4c00:16439] 0 exiting: rc = 1 00000100:00100000:2.0:1789607689.090187:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090194:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090198:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090202:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090207:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090212:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090228:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090234:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090239:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090249:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090255:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090260:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090265:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090272:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090276:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090280:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090285:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090290:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090294:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090299:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090304:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090309:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090314:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090318:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090322:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090327:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090331:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090336:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090340:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090344:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090348:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090353:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090358:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090363:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090368:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090373:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090378:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090383:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090389:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090393:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090398:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090411:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090416:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090422:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090428:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090432:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090436:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090442:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090447:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090451:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090494:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090500:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090505:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090509:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090514:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090518:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090522:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090527:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090530:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090535:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090540:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090544:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090548:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.090553:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607689.091281:0:16442:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8d78faae4000:16442] 1 exiting: rc = 0 00000100:00100000:2.0:1789607689.093191:0:16443:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8d78faae4200:16443] 2 exiting: rc = 0 00000100:00100000:1.0:1789607689.093425:0:16441:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8d78faae4a00:16441] 0 exiting: rc = 1 00000100:00100000:2.0:1789607689.093711:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093718:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093731:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093737:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093742:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093747:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093752:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093757:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093762:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093767:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093772:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093787:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093839:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093850:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093857:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093910:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093918:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093990:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.093996:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094011:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094021:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094026:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094032:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094037:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094042:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094047:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094053:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094058:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094063:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094068:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094073:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094079:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094085:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094097:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094105:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094110:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094115:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094120:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094125:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094130:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094135:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094140:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094145:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094162:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094168:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094173:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094184:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094189:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094194:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094199:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094204:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094209:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094214:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094220:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094224:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094229:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094234:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094239:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094243:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094248:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094253:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094265:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094270:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607689.094276:0:20423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789607689.098224:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607689.098237:0:20423:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789607689.098248:0:20423:0:(genops.c:885:class_export_put()) final put ffff8d79013be000/MDS_uuid 00000020:00000080:2.0:1789607689.098253:0:20423:0:(genops.c:844:class_export_destroy()) destroying export ffff8d79013be000/MDS_uuid for MDS 00000020:01000000:2.0:1789607689.098258:0:20423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789607689.098394:0:20423:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789607689.124474:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789607689.954135:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789607689.954145:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607689.954148:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789607689.954152:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789607689.954169:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607689.954176:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 589 00000100:00080000:0.0:1789607689.954181:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789607689.954193:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d77c10f0000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607689.954228:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78ff79ce00 x1876539150138368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607689.954285:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789607689.954288:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789607689.954290:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d78c635f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607689.954294:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 589 00000100:00080000:0.0:1789607689.954296:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789607689.954301:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d78c635f800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607689.954312:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78ff79d500 x1876539150138624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607689.954345:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150138752:0@lo:400:kworker.0 00000400:00000100:0.0:1789607689.954393:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150138752 offset 0 length 224: 4 00000100:00100000:0.0:1789607689.954429:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607689.954436:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150138496:0@lo:400:kworker.0 00000400:00000100:0.0:1789607689.954462:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150138496 offset 0 length 224: 4 00000100:00100000:1.0:1789607689.954617:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539150138368:0@lo:38:kworker.0 00000400:00000100:1.0:1789607689.954643:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150138368 offset 0 length 520: 4 00000100:00100000:1.0:1789607689.954658:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150138624:0@lo:38:kworker.0 00000400:00000100:1.0:1789607689.954672:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150138624 offset 0 length 520: 4 00010000:00010000:3.0:1789607690.147062:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607691.172960:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789607691.562372:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789607691.562382:0:8140:0:(genops.c:885:class_export_put()) final put ffff8d78f5861800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789607691.562494:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f5861800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789607691.562535:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78f5864800 for lustre-OST0000 00000020:01000004:1.0:1789607691.656785:0:20575:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789607691.676707:0:20575:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789607691.677085:0:20575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607691.677099:0:20575:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607691.677107:0:20575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607691.677127:0:20575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607691.677150:0:20575:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789607691.677155:0:20575:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789607691.677175:0:20575:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789607691.677186:0:20575:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78ff79ce00 x1876539150138368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789607704 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607691.677305:0:20575:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789607691.677312:0:20575:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789607691.677319:0:20575:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789607691.677324:0:20575:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789607691.677328:0:20575:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78ff79ce00 x1876539150138368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789607704 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789607691.677422:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607691.677429:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607691.677446:0:20575:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00010000:00010000:1.0:1789607691.677451:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c9185600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607691.677460:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607691.677469:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607691.677477:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607691.677483:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789607691.677485:0:16418:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789607691.677487:0:16418:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789607691.677499:0:16418:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d79013bc800 00010000:00010000:1.0:1789607691.677504:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607691.677511:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c9185600/0xa26202d240fbe919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbe920 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607691.677519:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539150138368:0@lo:38:kworker.0 00010000:00010000:1.0:1789607691.677522:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607691.677524:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607691.677525:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607691.677562:0:20575:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789607691.679064:0:20575:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789607691.679077:0:20575:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78ff79f480 x1876539150138496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607705 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607691.680229:0:20575:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789607691.680240:0:20575:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789607691.680266:0:20575:0:(import.c:65:import_set_state_nolock()) ffff8d77c10aa800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789607691.680318:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3467:1876539150138880:0@lo:39:umount.0 00000400:00000100:1.0:1789607691.680369:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150138880 offset 0 length 224: 4 00000100:00100000:0.0:1789607691.680752:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150138496:0@lo:400:kworker.0 00010000:00010000:0.0:1789607692.200394:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607693.218880:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789607693.986308:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607693.986318:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607693.986321:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607693.986324:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789607693.986453:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607693.986474:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150139008:0@lo:400:kworker.0 00000400:00000100:1.0:1789607693.986526:0:3469:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150139008 offset 0 length 224: 4 00010000:00010000:0.0:1789607694.242127:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789607695.010145:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789607695.010155:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607695.010158:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789607695.010178:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789607695.010292:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150139136:0@lo:400:kworker.0 00000400:00000100:1.0:1789607695.010365:0:3469:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150139136 offset 0 length 224: 4 00010000:00010000:1.0:1789607695.267518:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607696.290238:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607697.314721:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607698.340006:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607698.850242:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607688/real 1789607688] req@ffff8d78c61fd500 x1876539150138240/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789607698 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607698.850286:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78c61fd500 x1876539150138240/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789607698 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789607698.850312:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d79013bc800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607698.850341:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789607698.850346:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3467:1876539150138240:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1789607698.850460:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607698.850470:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789607698.850488:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d79013bc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607698.850496:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.125@tcp: connect to NID 0@lo last attempt 593 00000100:00080000:3.0:1789607698.850501:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.125@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789607698.850513:0:36:0:(import.c:666:import_select_connection()) MGC192.168.203.125@tcp: import ffff8d79013bc800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607698.850546:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d790133f480 x1876539150139264/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607698.851198:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3467:1876539150139264:0@lo:250:kworker.0 00000400:00000100:1.0:1789607698.851271:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876539150139264 offset 0 length 520: 4 00000100:00080000:3.0:1789607698.851348:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607698.851353:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789607698.852447:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607698.852466:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150139392:0@lo:400:kworker.0 00000400:00000100:0.0:1789607698.852507:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150139392 offset 0 length 224: 4 00010000:00010000:1.0:1789607699.363924:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607700.387678:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607701.412318:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607701.922090:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607691/real 1789607691] req@ffff8d78c61ff800 x1876539150138880/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789607701 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607701.922124:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78c61ff800 x1876539150138880/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789607701 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789607701.922138:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c10aa800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789607701.922162:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3467:1876539150138880:0@lo:39:umount.0 00000100:00080000:2.0:1789607701.922252:0:20575:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789607701.922258:0:20575:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789607701.922263:0:20575:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789607701.923210:0:20575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607701.923225:0:20575:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607701.923232:0:20575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607701.923239:0:20575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607701.923265:0:20575:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607701.923273:0:20575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607701.923280:0:20575:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607701.923286:0:20575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607701.923293:0:20575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607701.923328:0:20575:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789607701.923333:0:20575:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789607701.923353:0:20575:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789607701.923357:0:20575:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789607701.923372:0:20575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607701.923377:0:20575:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789607701.923381:0:20575:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8d78f9d2cd40) has no exports 00000020:00080000:2.0:1789607701.923411:0:20575:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8d78f9d2cd40) has no exports 00010000:00010000:0.0:1789607701.924836:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607701.924848:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607701.924858:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9200 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607701.924943:0:16417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607701.924954:0:16417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607701.924961:0:16417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607701.924966:0:16417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789607701.924969:0:16417:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789607701.924971:0:16417:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789607701.924990:0:16417:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d79013bc800 00010000:00010000:0.0:1789607701.924994:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607701.925001:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbe8ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbe8f6 expref: -99 pid: 17736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607701.925034:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607701.925038:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607701.925045:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77c571fa00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607701.925049:0:16417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607701.925057:0:16417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607701.925065:0:16417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1789607701.925074:0:20575:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78e9ceeb40 - data ffff8d78c211daf8/ffff8d78fc253800 10000000:01000000:0.0:1789607701.925142:0:16417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789607701.925145:0:16417:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789607701.925148:0:16417:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789607701.925159:0:16417:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d79013bc800 00010000:00010000:0.0:1789607701.925162:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607701.925168:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571fa00/0xa26202d240fbec45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbec4c expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607701.925181:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607701.925184:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607701.925188:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789607701.925242:0:20575:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78d9424900 - data ffff8d78cf294e58/ffff8d77c3aea400 00010000:00010000:1.0:1789607701.925487:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789607701.947906:0:20575:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789607701.979623:0:20575:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe904 00000020:00000080:2.0:1789607701.979633:0:20575:0:(genops.c:885:class_export_put()) final put ffff8d78c635b800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789607701.979644:0:20575:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78c78e0000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789607701.979647:0:20575:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78c78e0000 2 00000020:01000004:2.0:1789607701.979651:0:20575:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d78c78e0000 from lustre-OST0000 00000020:00000080:0.0:1789607701.979679:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78c635b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789607701.979680:0:20575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607701.979693:0:20575:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789607701.979697:0:20575:0:(genops.c:885:class_export_put()) final put ffff8d79013bf000/lustre-OST0000_UUID 00000020:00000080:2.0:1789607701.979699:0:20575:0:(genops.c:844:class_export_destroy()) destroying export ffff8d79013bf000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789607701.979706:0:20575:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789607701.979750:0:20575:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789607701.979755:0:20575:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789607701.979759:0:20575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607701.979764:0:20575:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789607701.979771:0:20575:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d77c10ac800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789607701.979777:0:20575:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff8d78e9ee99c0) has exports, disconnecting them 00000020:00080000:2.0:1789607701.979781:0:20575:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d77c10ac800), last request at 1789607619 00000020:00000080:2.0:1789607701.979796:0:20575:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe92e 00000020:00080000:2.0:1789607701.979807:0:20575:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d77c10ac800): rc 0 00000020:00000080:2.0:1789607701.979811:0:20575:0:(genops.c:885:class_export_put()) final put ffff8d77c10ac800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789607701.984123:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c10ac800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789607701.985621:0:20575:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789607701.985630:0:20575:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607701.985635:0:20575:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789607701.985641:0:20575:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789607701.986673:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c10f0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789607701.986968:0:20575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607701.986977:0:20575:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789607701.986983:0:20575:0:(genops.c:885:class_export_put()) final put ffff8d7901033000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789607701.986997:0:20575:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7901033000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789607701.987007:0:20575:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1789607701.987068:0:20575:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789607701.987073:0:20575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607701.987078:0:20575:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789607701.987084:0:20575:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d78c520f000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789607701.987090:0:20575:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff8d77c41919c0) has exports, disconnecting them 00000020:00080000:1.0:1789607701.987095:0:20575:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d78c520f000), last request at 1789607619 00000020:00000080:1.0:1789607701.987098:0:20575:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe943 00000020:00080000:1.0:1789607701.987114:0:20575:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78c520f000): rc 0 00000020:00000080:1.0:1789607701.987118:0:20575:0:(genops.c:885:class_export_put()) final put ffff8d78c520f000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789607701.987975:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78c520f000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789607701.991051:0:20575:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789607701.991062:0:20575:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789607701.991067:0:20575:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789607701.991074:0:20575:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789607701.991104:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c10aa800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789607701.991261:0:20575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607701.991269:0:20575:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789607701.991274:0:20575:0:(genops.c:885:class_export_put()) final put ffff8d77c10ab800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789607701.991278:0:20575:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c10ab800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789607701.991283:0:20575:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789607701.991338:0:20575:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78c78e0000 1 00000020:00000080:0.0:1789607701.991343:0:20575:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe8e1 00000020:00000080:0.0:1789607701.991349:0:20575:0:(genops.c:885:class_export_put()) final put ffff8d78f849f000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789607701.991366:0:20575:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789607701.991374:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f849f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789607701.991385:0:20575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607701.991390:0:20575:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789607701.991394:0:20575:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff8d78c5b90000) has no exports 00000020:00000080:0.0:1789607702.017633:0:20575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607702.017648:0:20575:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789607702.017653:0:20575:0:(genops.c:885:class_export_put()) final put ffff8d78cffb8800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789607702.017657:0:20575:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78cffb8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789607702.017667:0:20575:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789607702.017806:0:20575:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d78cffbc800 00000020:02000400:0.0:1789607702.017849:0:20575:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789607702.434308:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607703.460039:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789607704.305575:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789607704.305585:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607704.305588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789607704.305591:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789607704.305654:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607704.305670:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150139520:0@lo:400:kworker.0 00000400:00000100:2.0:1789607704.305724:0:3470:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150139520 offset 0 length 224: 4 00010000:00010000:0.0:1789607704.483054:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789607704.947195:0:20728:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789607704.957271:0:20728:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789607704.957357:0:20728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607704.957373:0:20728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607704.957381:0:20728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607704.957388:0:20728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607704.957402:0:20728:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789607704.957407:0:20728:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789607704.957427:0:20728:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607704.957440:0:20728:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78ff79d500 x1876539150138624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789607704 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607704.957456:0:20728:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789607704.957488:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c635f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607704.957502:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1789607704.957518:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150138624:0@lo:38:kworker.0 00000100:00080000:0.0:1789607704.957561:0:20728:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789607704.957566:0:20728:0:(import.c:65:import_set_state_nolock()) ffff8d78c635f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789607704.957571:0:20728:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607704.957587:0:20728:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789607704.957591:0:20728:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789607704.957895:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607704.957903:0:16418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607704.957911:0:16418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075d800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607704.957915:0:16418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607704.957924:0:16418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607704.957932:0:16418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607704.957938:0:16418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789607704.957940:0:16418:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789607704.957943:0:16418:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789607704.957961:0:16418:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d79013bc800 00010000:00010000:1.0:1789607704.957965:0:16418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607704.957972:0:16418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78e075d800/0xa26202d240fbea7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbea85 expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607704.957983:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607704.957985:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607704.957987:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789607704.958055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607704.958060:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789607704.958394:0:20728:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789607704.958402:0:20728:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78ff79c380 x1876539150138752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607705 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607704.958423:0:20728:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d790133c700 x1876539150139008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607709 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607704.958438:0:20728:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78c61fd180 x1876539150139136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607711 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607704.958446:0:20728:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d790133c380 x1876539150139392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607714 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607704.958453:0:20728:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78c61fdf80 x1876539150139520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607720 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607704.958465:0:20728:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789607704.958469:0:20728:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789607704.958490:0:20728:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f4000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789607704.958530:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150139520:0@lo:400:kworker.0 00000100:00100000:0.0:1789607704.958531:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150139136:0@lo:400:kworker.0 00000100:00100000:0.0:1789607704.958538:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150139008:0@lo:400:kworker.0 00000100:00100000:1.0:1789607704.958567:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3467:1876539150139648:0@lo:39:umount.0 00000400:00000100:1.0:1789607704.958611:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539150139648 offset 0 length 224: 4 00000100:00100000:3.0:1789607704.958753:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150139392:0@lo:400:kworker.0 00000100:00100000:3.0:1789607704.958761:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150138752:0@lo:400:kworker.0 00010000:00010000:0.0:1789607705.506072:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607706.530095:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607707.554150:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607708.578127:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607709.602176:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789607710.434016:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607710.434026:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789607710.626074:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607711.650259:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607712.674998:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607713.186354:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607698/real 1789607698] req@ffff8d790133f480 x1876539150139264/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789607713 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607713.186389:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d790133f480 x1876539150139264/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789607713 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789607713.186411:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d79013bc800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607713.186438:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789607713.186442:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3467:1876539150139264:0@lo:250:kworker.0 00000100:00080000:0.0:1789607713.186533:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789607713.186539:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789607713.186542:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d79013bc800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607713.186547:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.125@tcp: connect to NID 0@lo last attempt 603 00000100:00080000:0.0:1789607713.186552:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.125@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789607713.186564:0:36:0:(import.c:666:import_select_connection()) MGC192.168.203.125@tcp: import ffff8d79013bc800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607713.186601:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78ff79d500 x1876539150139776/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607713.186652:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3467:1876539150139776:0@lo:250:kworker.0 00000400:00000100:1.0:1789607713.186696:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876539150139776 offset 0 length 520: 4 00010000:00010000:0.0:1789607713.698032:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607714.212401:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607704/real 1789607704] req@ffff8d78cf7c7800 x1876539150139648/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789607714 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607714.212435:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78cf7c7800 x1876539150139648/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789607714 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789607714.212453:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c10f4000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789607714.212478:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3467:1876539150139648:0@lo:39:umount.0 00000100:00080000:3.0:1789607714.215904:0:20728:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789607714.215913:0:20728:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789607714.215921:0:20728:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789607714.217022:0:20728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607714.217039:0:20728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607714.217047:0:20728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607714.217068:0:20728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607714.217099:0:20728:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789607714.217107:0:20728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607714.217113:0:20728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607714.217119:0:20728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607714.217125:0:20728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607714.217336:0:20728:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789607714.217342:0:20728:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789607714.217363:0:20728:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789607714.217368:0:20728:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789607714.217373:0:20728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607714.217378:0:20728:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789607714.217382:0:20728:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff8d78e9eecd40) has no exports 00000020:00080000:3.0:1789607714.217407:0:20728:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff8d78e9eecd40) has no exports 00010000:00010000:0.0:1789607714.221798:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607714.221815:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607714.221828:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075c200 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607714.221832:0:16417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607714.221842:0:16417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607714.221884:0:16417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607714.221890:0:16417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789607714.221893:0:16417:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789607714.221896:0:16417:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789607714.221914:0:16417:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d79013bc800 00010000:00010000:0.0:1789607714.221918:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607714.221924:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78e075c200/0xa26202d240fbea54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbea5b expref: -99 pid: 18460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607714.223698:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607714.223709:0:16417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607714.223720:0:16417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd580400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607714.223724:0:16417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607714.223735:0:16417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607714.223743:0:16417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607714.223749:0:16417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789607714.223751:0:16417:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789607714.223768:0:16417:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789607714.223785:0:16417:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d79013bc800 00010000:00010000:0.0:1789607714.223789:0:16417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607714.223796:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd580400/0xa26202d240fbec37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbec3e expref: -99 pid: 16427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607714.223816:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607714.223818:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607714.223821:0:16417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607714.224076:0:16418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789607714.224371:0:20728:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78cfcb07e0 - data ffff8d78fbe226c0/ffff8d77c4da7400 00000020:01000000:3.0:1789607714.224533:0:20728:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d78cfcb0de0 - data ffff8d78fbcfb0d8/ffff8d78ef28d400 00100000:10000000:3.0:1789607714.238579:0:20728:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789607714.271261:0:20728:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbea69 00000020:00000080:1.0:1789607714.271280:0:20728:0:(genops.c:885:class_export_put()) final put ffff8d77c48f9800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1789607714.271303:0:20728:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78fd000800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1789607714.271306:0:20728:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78fd000800 2 00000020:01000004:1.0:1789607714.271309:0:20728:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d78fd000800 from lustre-OST0001 00000020:00000080:1.0:1789607714.271345:0:20728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607714.271356:0:20728:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789607714.271359:0:20728:0:(genops.c:885:class_export_put()) final put ffff8d77c10f7000/lustre-OST0001_UUID 00000020:00000080:1.0:1789607714.271362:0:20728:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c10f7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789607714.271369:0:20728:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789607714.271472:0:20728:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7095b5c7-e12e-406f-ad0b-bb55e8b45703->MGS 00010000:00010000:1.0:1789607714.271491:0:20728:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d77c571e400/0xa26202d240fbe7ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbe7b4 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607714.271503:0:20728:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d77c571e400/0xa26202d240fbe7ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbe7b4 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607714.271509:0:20728:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789607714.271511:0:20728:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789607714.271515:0:20728:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789607714.271527:0:20728:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d79013bc800 00010000:00010000:1.0:1789607714.271531:0:20728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d77c571e400/0xa26202d240fbe7ad lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbe7b4 expref: -99 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607714.271545:0:20728:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607714.271551:0:20728:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607714.271555:0:20728:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789607714.271557:0:20728:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789607714.271559:0:20728:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789607714.271571:0:20728:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d79013bc800 00010000:00010000:1.0:1789607714.271573:0:20728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd580000/0xa26202d240fbe69c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa26202d240fbe6a3 expref: -99 pid: 16411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789607714.271600:0:20728:0:(import.c:65:import_set_state_nolock()) ffff8d79013bc800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789607714.271604:0:20728:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789607714.271608:0:20728:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789607714.271609:0:20728:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789607714.271613:0:20728:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789607714.271624:0:20728:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d78ff79d500 x1876539150139776/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789607733 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789607714.271639:0:20728:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789607714.271642:0:20728:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1789607714.271669:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7095b5c7-e12e-406f-ad0b-bb55e8b45703:3467:1876539150139776:0@lo:250:kworker.0 10000000:01000000:1.0:1789607714.271691:0:20728:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789607714.271697:0:20728:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbe687 00000020:00000080:1.0:1789607714.271701:0:20728:0:(genops.c:885:class_export_put()) final put ffff8d79013b9800/7095b5c7-e12e-406f-ad0b-bb55e8b45703 00000020:01000000:1.0:1789607714.271706:0:20728:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.125@tcp (flags='') 00000020:00000080:1.0:1789607714.271710:0:20728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607714.271715:0:20728:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.125@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789607714.271718:0:20728:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8d78fd3f3380) has no exports 10000000:01000000:1.0:1789607714.271732:0:16427:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789607714.271769:0:20728:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.125@tcp: client import never connected 00000100:00080000:1.0:1789607714.271772:0:20728:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789607714.271774:0:20728:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789607714.271776:0:20728:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789607714.271778:0:20728:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789607714.271801:0:20728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607714.271805:0:20728:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.125@tcp (uuid 7095b5c7-e12e-406f-ad0b-bb55e8b45703) 00000020:01000000:1.0:1789607714.271810:0:20728:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789607714.271812:0:20728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607714.271815:0:20728:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789607714.271820:0:20728:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d78ef3cf800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789607714.271825:0:20728:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff8d78e9ee8000) has exports, disconnecting them 00000020:00080000:1.0:1789607714.271834:0:20728:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d78ef3cf800), last request at 1789607633 00000020:00000080:1.0:1789607714.271838:0:20728:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbea93 00000020:00080000:1.0:1789607714.271849:0:20728:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d78ef3cf800): rc 0 00000020:00000080:1.0:1789607714.271853:0:20728:0:(genops.c:885:class_export_put()) final put ffff8d78ef3cf800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789607714.272550:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c48f9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789607714.272561:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d79013b9800/7095b5c7-e12e-406f-ad0b-bb55e8b45703 for MGC192.168.203.125@tcp 00000020:00000080:2.0:1789607714.272566:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d79013bc800 for MGC192.168.203.125@tcp 00000020:00000080:2.0:1789607714.272570:0:36:0:(genops.c:885:class_export_put()) final put ffff8d79013ba800/7095b5c7-e12e-406f-ad0b-bb55e8b45703 00000020:00000080:2.0:1789607714.272572:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d79013ba800/7095b5c7-e12e-406f-ad0b-bb55e8b45703 for MGC192.168.203.125@tcp 00000020:01000000:2.0:1789607714.272576:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.125@tcp (7095b5c7-e12e-406f-ad0b-bb55e8b45703) 00000020:00000080:2.0:1789607714.272797:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78ef3cf800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789607714.273656:0:20728:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789607714.273661:0:20728:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607714.273665:0:20728:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789607714.273671:0:20728:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789607714.273691:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d78c635f800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789607714.273818:0:20728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607714.273825:0:20728:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789607714.273830:0:20728:0:(genops.c:885:class_export_put()) final put ffff8d77c48ff000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789607714.273832:0:20728:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c48ff000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789607714.273841:0:20728:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789607714.273925:0:20728:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789607714.273930:0:20728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607714.273935:0:20728:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789607714.273941:0:20728:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8d77c10f6000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789607714.273960:0:20728:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff8d78e9eeb380) has exports, disconnecting them 00000020:00080000:0.0:1789607714.273964:0:20728:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8d77c10f6000), last request at 1789607633 00000020:00000080:0.0:1789607714.273967:0:20728:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbeaa8 00000020:00080000:0.0:1789607714.273978:0:20728:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d77c10f6000): rc 0 00000020:00000080:0.0:1789607714.273992:0:20728:0:(genops.c:885:class_export_put()) final put ffff8d77c10f6000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1789607714.274019:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c10f6000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789607714.340949:0:20728:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789607714.340958:0:20728:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789607714.340961:0:20728:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789607714.340968:0:20728:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789607714.341985:0:16417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1789607714.342316:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8d77c10f4000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789607714.342675:0:16418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1789607714.343981:0:16412:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d78f61ab200:16412] 0 exiting: rc = 1 00000100:00100000:2.0:1789607714.344806:0:16413:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d77c418c200:16413] 1 exiting: rc = 0 00000100:00100000:2.0:1789607714.345015:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.355191:0:16414:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d77c418c400:16414] 0 exiting: rc = 1 00000100:00100000:0.0:1789607714.355203:0:16415:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d78f61ab400:16415] 1 exiting: rc = 0 00000100:00100000:2.0:1789607714.355292:0:19178:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d77c5b6c000:19178] 3 exiting: rc = 0 00000100:00100000:1.0:1789607714.355312:0:16416:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d77c418c800:16416] 2 exiting: rc = 0 00000100:00100000:2.0:1789607714.355396:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355404:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355410:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355415:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355434:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355440:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355444:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355449:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355454:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355459:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355464:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355470:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355476:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355481:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355485:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355490:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355495:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355502:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355507:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355511:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355516:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355520:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355525:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355530:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355535:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355539:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355544:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355548:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355553:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355558:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355562:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355567:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355572:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355576:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355581:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355586:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355592:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355597:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355600:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355614:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355618:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355623:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355627:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355632:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355637:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355641:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355645:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355650:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355655:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355659:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355664:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355668:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355673:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355678:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355683:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355688:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355693:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355698:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355703:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355707:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355711:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355716:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355721:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.355726:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789607714.356818:0:20728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607714.356829:0:20728:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1789607714.356835:0:20728:0:(genops.c:885:class_export_put()) final put ffff8d78fd004000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1789607714.356839:0:20728:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78fd004000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1789607714.356845:0:20728:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1789607714.356909:0:20728:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78fd000800 1 00000020:00000080:2.0:1789607714.356915:0:20728:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa26202d240fbea4d 00000020:00000080:2.0:1789607714.356922:0:20728:0:(genops.c:885:class_export_put()) final put ffff8d77c5f23000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789607714.356937:0:20728:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789607714.357037:0:20728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607714.357042:0:20728:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789607714.357046:0:20728:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff8d78f9d299c0) has no exports 00000020:00000080:1.0:1789607714.359678:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77c5f23000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789607714.387259:0:20728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607714.387299:0:20728:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789607714.387305:0:20728:0:(genops.c:885:class_export_put()) final put ffff8d78d82a3800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789607714.387309:0:20728:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78d82a3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789607714.387319:0:20728:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789607714.387476:0:20728:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d78fd002000 00000020:01000000:3.0:1789607714.387497:0:20728:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789607714.387501:0:20728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607714.387506:0:20728:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789607714.387511:0:20728:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8d77c4194d40) has no exports 00000020:00000080:3.0:1789607714.387532:0:20728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607714.387537:0:20728:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789607714.387540:0:20728:0:(genops.c:885:class_export_put()) final put ffff8d78f849c800/OSS_uuid 00000020:00000080:3.0:1789607714.387543:0:20728:0:(genops.c:844:class_export_destroy()) destroying export ffff8d78f849c800/OSS_uuid for OSS 00000020:01000000:3.0:1789607714.387552:0:20728:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1789607714.389791:0:16425:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789607714.390450:0:17737:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8d78e0e2e200:17737] 0 exiting: rc = 1 00000100:00100000:2.0:1789607714.390547:0:17740:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8d78cfc30800:17740] 2 exiting: rc = 0 00000100:00100000:1.0:1789607714.390615:0:17739:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8d78fc91da00:17739] 1 exiting: rc = 0 00000100:00100000:1.0:1789607714.390673:0:17881:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8d78fc2fa800:17881] 3 exiting: rc = 0 00000100:00100000:3.0:1789607714.393063:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393078:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393083:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393089:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393094:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393099:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393104:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393109:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393114:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393121:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393126:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393131:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393136:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393140:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393145:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393150:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393155:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393160:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393165:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393170:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393187:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393192:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393197:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393208:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393214:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393219:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393224:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393232:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393237:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393242:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393247:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393253:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393258:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393263:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393276:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393282:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393287:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393292:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393297:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393302:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393307:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393312:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393320:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393325:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393331:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393335:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393340:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393344:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393349:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393354:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393358:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393362:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393368:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393373:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393379:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393390:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393394:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393399:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393404:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393409:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393414:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393419:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393424:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.393428:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.394459:0:17741:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d78faaffc00:17741] 0 exiting: rc = 1 00000100:00100000:2.0:1789607714.394814:0:17742:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d78faaff400:17742] 1 exiting: rc = 0 00000100:00100000:3.0:1789607714.394913:0:19384:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8d77c5c18e00:19384] 2 exiting: rc = 0 00000100:00100000:0.0:1789607714.395041:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395049:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395054:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395059:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395064:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395069:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395073:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395079:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395084:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395089:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395094:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395098:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395102:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395107:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395111:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395116:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395120:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395125:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395130:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395135:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395139:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395144:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395149:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395154:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395158:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395162:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395167:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395186:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395191:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395195:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395200:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395204:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395210:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395215:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395220:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395227:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395232:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395237:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395242:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395247:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395252:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395257:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395262:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395277:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395283:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395287:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395292:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395297:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395304:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395309:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395314:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395318:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395323:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395327:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395334:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395339:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395343:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395348:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395360:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395368:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395373:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395378:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395389:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607714.395394:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607714.397168:0:17744:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d78d27cd000:17744] 1 exiting: rc = 0 00000100:00100000:3.0:1789607714.397480:0:17743:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d78cfcfaa00:17743] 0 exiting: rc = 1 00000100:00100000:0.0:1789607714.398283:0:17745:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d77c43efe00:17745] 2 exiting: rc = 0 00000100:00100000:1.0:1789607714.398429:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398438:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398444:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398450:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398455:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398461:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398466:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398471:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398477:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398483:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398489:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398494:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398500:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398506:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398512:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398517:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398524:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398561:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398568:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398574:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398579:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398584:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398589:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398595:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398600:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398606:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398612:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398617:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398623:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398630:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398635:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398640:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398646:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398652:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398657:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398663:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398668:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398674:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398679:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398685:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398690:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398711:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398718:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398725:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398731:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398736:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398743:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398748:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398753:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398759:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398764:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398769:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398781:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398787:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398793:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398798:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398804:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398825:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398832:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398846:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.398853:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.399155:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.399164:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607714.399170:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403538:0:17746:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d77c444d200:17746] 0 exiting: rc = 1 00000100:00100000:0.0:1789607714.403714:0:17747:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d77c5937200:17747] 1 exiting: rc = 0 00000100:00100000:3.0:1789607714.403809:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403816:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403822:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403828:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403834:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403839:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403844:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403850:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403855:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403949:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403957:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403962:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403969:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403974:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403979:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403985:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403991:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.403996:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404001:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404005:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404010:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404015:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404031:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404036:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404041:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404046:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404050:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404117:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404124:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404130:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404135:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404140:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404145:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404150:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404154:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404160:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404165:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404173:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404178:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404183:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404189:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404195:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404278:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404286:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404293:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404298:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404304:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404310:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404315:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404320:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404325:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404330:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404335:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404341:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404346:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404350:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404355:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404368:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404373:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404378:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404383:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404388:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404394:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.404400:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405125:0:17749:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d78c304b400:17749] 1 exiting: rc = 0 00000100:00100000:0.0:1789607714.405361:0:17748:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d78e0b14800:17748] 0 exiting: rc = 1 00000100:00100000:3.0:1789607714.405448:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405455:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405461:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405468:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405498:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405505:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405511:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405518:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405525:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405531:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405538:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405545:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405552:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405557:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405564:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405570:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405592:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405599:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405604:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405610:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405617:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405622:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405628:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405634:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405640:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405645:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405651:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405669:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405688:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405696:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405702:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405708:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405714:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405720:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405729:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405734:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405742:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405749:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405756:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405767:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405788:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405796:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405802:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405807:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405813:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405819:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405825:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405833:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405838:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405844:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405850:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405972:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.405997:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.406005:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.406010:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.406015:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.406022:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.406027:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.406032:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.406038:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.406043:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.406049:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.406060:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789607714.406066:0:20728:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789607714.421554:0:20728:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789607735.078025:0:21448:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789607743.315898:0:21912:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789607743.315905:0:21912:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789607743.316021:0:21912:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d78c2f72000 00000020:01000004:2.0:1789607743.316035:0:21912:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789607743.316043:0:21912:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789607743.316066:0:21912:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d78c5b93380) 00000020:00000080:2.0:1789607743.316080:0:21912:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789607743.345100:0:21912:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789607743.348438:0:21912:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:3.0:1789607743.348748:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1789607743.349143:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1789607743.349361:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1789607743.349441:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1789607743.349604:0:21912:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789607743.349657:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1789607743.349737:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 451: rc = 0 00100000:10000000:3.0:1789607743.349905:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1789607743.350524:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1789607743.352334:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 373: rc = 0 00100000:10000000:3.0:1789607743.352430:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 373: rc = 0 00100000:10000000:3.0:1789607743.353384:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 378: rc = 0 00100000:10000000:3.0:1789607743.353632:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 378: rc = 0 00100000:10000000:3.0:1789607743.354333:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 378: rc = 0 00100000:10000000:3.0:1789607743.354581:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 378: rc = 0 00100000:10000000:3.0:1789607743.355073:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 378: rc = 0 00100000:10000000:3.0:1789607743.355496:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 378: rc = 0 00100000:10000000:3.0:1789607743.355744:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 378: rc = 0 00100000:10000000:3.0:1789607743.356443:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 378: rc = 0 00100000:10000000:3.0:1789607743.356676:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 378: rc = 0 00100000:10000000:3.0:1789607743.357174:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 378: rc = 0 00100000:10000000:3.0:1789607743.357668:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 378: rc = 0 00100000:10000000:3.0:1789607743.357973:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 378: rc = 0 00100000:10000000:3.0:1789607743.358428:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 772: rc = 0 00100000:10000000:3.0:1789607743.358699:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 772: rc = 0 00100000:10000000:3.0:1789607743.358974:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 772: rc = 0 00100000:10000000:3.0:1789607743.359222:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 772: rc = 0 00100000:10000000:3.0:1789607743.359445:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 772: rc = 0 00100000:10000000:3.0:1789607743.359684:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 772: rc = 0 00100000:10000000:3.0:1789607743.359937:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 772: rc = 0 00100000:10000000:3.0:1789607743.361515:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 772: rc = 0 00100000:10000000:3.0:1789607743.361781:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 772: rc = 0 00100000:10000000:3.0:1789607743.362361:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 772: rc = 0 00100000:10000000:3.0:1789607743.362595:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 772: rc = 0 00100000:10000000:3.0:1789607743.362857:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 772: rc = 0 00100000:10000000:3.0:1789607743.363498:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 772: rc = 0 00100000:10000000:3.0:1789607743.363720:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 772: rc = 0 00100000:10000000:3.0:1789607743.363981:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 772: rc = 0 00100000:10000000:3.0:1789607743.364646:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 772: rc = 0 00100000:10000000:3.0:1789607743.365089:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 772: rc = 0 00100000:10000000:3.0:1789607743.365481:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 772: rc = 0 00100000:10000000:3.0:1789607743.365715:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 772: rc = 0 00100000:10000000:3.0:1789607743.368311:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 772: rc = 0 00100000:10000000:3.0:1789607743.368603:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 772: rc = 0 00100000:10000000:3.0:1789607743.369291:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 772: rc = 0 00100000:10000000:3.0:1789607743.369545:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 772: rc = 0 00100000:10000000:3.0:1789607743.369799:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 772: rc = 0 00100000:10000000:3.0:1789607743.370490:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 772: rc = 0 00100000:10000000:3.0:1789607743.370819:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 772: rc = 0 00100000:10000000:3.0:1789607743.371105:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 772: rc = 0 00100000:10000000:3.0:1789607743.371601:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 772: rc = 0 00100000:10000000:3.0:1789607743.372276:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 772: rc = 0 00100000:10000000:3.0:1789607743.372539:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 772: rc = 0 00100000:10000000:3.0:1789607743.372780:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 772: rc = 0 00100000:10000000:2.0:1789607743.373553:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 772: rc = 0 00100000:10000000:2.0:1789607743.373975:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 457: rc = 0 00100000:10000000:2.0:1789607743.374174:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 457: rc = 0 00100000:10000000:2.0:1789607743.375024:0:21912:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789607743.375486:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 551: rc = 0 00100000:10000000:2.0:1789607743.375689:0:21912:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789607743.375760:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 551: rc = 0 00100000:10000000:2.0:1789607743.376395:0:21912:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789607743.376458:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 551: rc = 0 00100000:10000000:2.0:1789607743.377131:0:21912:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789607743.377228:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 374: rc = 0 00100000:10000000:2.0:1789607743.377412:0:21912:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789607743.377475:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 374: rc = 0 00100000:10000000:2.0:1789607743.377652:0:21912:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789607743.377721:0:21912:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 374: rc = 0 00000020:00000080:2.0:1789607743.378213:0:21912:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789607743.378222:0:21912:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789607743.378231:0:21912:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbef71 00000020:01000004:2.0:1789607743.378240:0:21912:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789607743.378245:0:21912:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789607743.378250:0:21912:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d78c2f72000 from MGS 00000020:01000004:2.0:1789607743.378254:0:21912:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789607743.378264:0:21912:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d78c5b94d40) 00000020:00000080:2.0:1789607743.378274:0:21912:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789607743.378332:0:21912:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78c2f72000 from MGS, refs=2 00080000:01000000:2.0:1789607743.378336:0:21912:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789607743.378341:0:21912:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbef7f 00000100:00100000:2.0:1789607743.378440:0:21912:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789607743.378573:0:21912:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789607743.378579:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789607743.379780:0:21912:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789607743.379799:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789607743.381069:0:21912:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607743.381382:0:21912:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789607743.381389:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789607743.382599:0:21912:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789607743.382609:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789607743.383003:0:21912:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789607743.383010:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789607743.388895:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607743.388901:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607743.388903:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607743.389235:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607743.389238:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607743.389240:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607743.389914:0:21912:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789607743.391548:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789607743.402144:0:21912:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789607743.402162:0:21912:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789607743.402164:0:21912:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789607743.408063:0:21921:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789607743.414557:0:21912:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789607743.414678:0:21912:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789607743.415456:0:21912:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789607743.415747:0:21912:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607743.416103:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789607743.416110:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789607743.417464:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789607743.417474:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789607743.417780:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789607743.417790:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789607743.418726:0:21912:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789607743.418745:0:21912:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.125@tcp' 00000020:01000004:2.0:1789607743.418746:0:21912:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789607743.418772:0:21912:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.125@tcp (typ=mgc) 00000020:00000080:2.0:1789607743.418784:0:21912:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.125@tcp (ffff8d78c5b919c0) 00000020:00000080:2.0:1789607743.418797:0:21912:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789607743.418929:0:21912:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78e0e9a000@MGC192.168.203.125@tcp: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1789607743.419070:0:21912:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.125@tcp-0 is initialized 00000040:01000000:2.0:1789607743.419076:0:21912:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789607743.419573:0:21927:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789607743.419632:0:21912:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.125@tcp (uuid 77c69b89-f077-4f20-ab40-68d85082562e) 00000020:00000080:1.0:1789607743.419649:0:21912:0:(genops.c:1384:class_connect()) connect: client 77c69b89-f077-4f20-ab40-68d85082562e, cookie 0xa26202d240fbef8d 00000100:00080000:1.0:1789607743.419658:0:21912:0:(import.c:545:import_select_connection()) MGC192.168.203.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789607743.419665:0:21912:0:(import.c:666:import_select_connection()) MGC192.168.203.125@tcp: import ffff8d78e0e9a000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607743.419695:0:21912:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cf7c7800 x1876539150139904/t0(0) o250->MGC192.168.203.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607743.419722:0:21912:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 77c69b89-f077-4f20-ab40-68d85082562e->MGS 00000020:01000004:1.0:1789607743.419741:0:21912:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789607743.419746:0:21912:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789607743.419755:0:21912:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d77c4194d40) 00000020:00000080:1.0:1789607743.419763:0:21912:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789607743.419887:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:77c69b89-f077-4f20-ab40-68d85082562e:3467:1876539150139904:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789607743.419947:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607743.420095:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150139904 00000100:00100000:0.0:1789607743.420103:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150139904 00000100:00100000:0.0:1789607743.420137:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789607743.420145:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f634a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3467:x1876539150139904:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789607743.420168:0:21923:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 77c69b89-f077-4f20-ab40-68d85082562e@0@lo t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:0.0:1789607743.420198:0:21923:0:(genops.c:1384:class_connect()) connect: client 77c69b89-f077-4f20-ab40-68d85082562e, cookie 0xa26202d240fbef9b 00000100:00080000:0.0:1789607743.420305:0:21923:0:(import.c:65:import_set_state_nolock()) ffff8d78f77be000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607743.420349:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f634a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+5:3467:x1876539150139904:12345-0@lo:250:mount.lustre.0 Request processed in 204us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607743.420355:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789607743.420393:0:21926:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1789607743.420499:0:3467:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789607743.420507:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.125@tcp: connect to target with instance 0 00000100:00080000:2.0:1789607743.420513:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789607743.420517:0:3467:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789607743.420520:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78e0e9a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789607743.420522:0:3467:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789607743.420535:0:3467:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789607743.420539:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:77c69b89-f077-4f20-ab40-68d85082562e:3467:1876539150139904:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789607743.439837:0:21912:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607743.440150:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789607743.440156:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789607743.442596:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789607743.442612:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789607743.444813:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789607743.444824:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789607743.445670:0:21912:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607743.445841:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789607743.445858:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789607743.446655:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789607743.446663:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789607743.492638:0:21912:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607743.493487:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789607743.493494:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789607743.495592:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789607743.495607:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789607743.496506:0:21912:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607743.497163:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789607743.497170:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789607743.498398:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789607743.498408:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789607743.499779:0:21912:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607743.500404:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789607743.500410:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789607743.501384:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789607743.501392:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789607743.502462:0:21912:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607743.502701:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789607743.502707:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789607743.504273:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789607743.504283:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789607743.535638:0:21912:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607743.536380:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789607743.536388:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789607743.539129:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789607743.539144:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789607743.542635:0:21912:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789607743.542658:0:21912:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789607743.544407:0:21912:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789607743.544436:0:21912:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789607743.544443:0:21912:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789607743.545500:0:21912:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789607743.545548:0:21912:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.125@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789607743.545552:0:21912:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789607743.545554:0:21912:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607743.545555:0:21912:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607743.545556:0:21912:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607743.545558:0:21912:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607743.545559:0:21912:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607743.545560:0:21912:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607743.545621:0:21912:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607743.545623:0:21912:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607743.545625:0:21912:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789607743.545628:0:21912:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789607743.545630:0:21912:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607743.545631:0:21912:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607743.545632:0:21912:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607743.545633:0:21912:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607743.545634:0:21912:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607743.545636:0:21912:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607743.545642:0:21912:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607743.545643:0:21912:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607743.545644:0:21912:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607743.545645:0:21912:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789607743.545669:0:21912:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789607743.545689:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789607743.545765:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607743.545812:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d3332540 going to sleep for 11 seconds 00000100:00100000:0.0:1789607743.546146:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150140032 00000100:00100000:0.0:1789607743.546153:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150140032 00000100:00100000:0.0:1789607743.546464:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607743.546475:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+5:21912:x1876539150140032:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789607743.546521:0:21925:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789607743.546524:0:21925:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789607743.546527:0:21925:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789607743.547631:0:21946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789607743.548069:0:21925:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1789607743.550775:0:21947:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789607743.550782:0:21947:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789607743.550785:0:21947:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789607743.550787:0:21947:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789607743.550830:0:21947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789607743.551652:0:21925:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789607743.551663:0:21925:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789607743.557563:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+5:21912:x1876539150140032:12345-0@lo:253:mount.lustre.0 Request processed in 11082us (11789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607743.557581:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607743.557683:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140032:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789607743.557696:0:21912:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789607743.557700:0:21912:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607743.557701:0:21912:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789607743.557703:0:21912:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607743.557704:0:21912:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607743.557706:0:21912:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607743.557707:0:21912:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607743.557708:0:21912:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607743.557710:0:21912:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789607743.557711:0:21912:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607743.557724:0:21912:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789607743.557743:0:21912:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d78c2f72000 from lustre-MDT0000 10000000:01000000:2.0:1789607743.557766:0:21912:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789607743.557769:0:21912:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789607743.557773:0:21912:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d78c5b919c0 10000000:01000000:2.0:1789607743.557777:0:21912:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789607743.557784:0:21912:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d78c5b919c0 from 1 10000000:01000000:2.0:1789607743.557787:0:21912:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789607743.557823:0:21912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.557834:0:21912:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.557854:0:21912:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607743.557896:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607743.558129:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607743.558169:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150140160 00000100:00100000:2.0:1789607743.558175:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150140160 00000100:00100000:2.0:1789607743.558384:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607743.558392:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+5:21912:x1876539150140160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607743.558405:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607743.558419:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c0031c00/0xa26202d240fbefa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbefa2 expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.558440:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c0031c00/0xa26202d240fbefa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbefa2 expref: 6 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.558449:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c0031c00/0xa26202d240fbefa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbefa2 expref: 6 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.558466:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c0031c00, rc 0) 00000100:00100000:2.0:1789607743.558508:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+6:21912:x1876539150140160:12345-0@lo:101:mount.lustre.0 Request processed in 117us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607743.558515:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607743.558550:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.558565:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607743.558579:0:21912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefa9 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.558587:0:21912:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbefa9 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607743.558638:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607743.558663:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607743.558679:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607743.558785:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150140288 00000100:00100000:1.0:1789607743.558790:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150140288 00000100:00100000:1.0:1789607743.558820:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607743.558826:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+6:21912:x1876539150140288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607743.559082:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+6:21912:x1876539150140288:12345-0@lo:501:mount.lustre.0 Request processed in 255us (418us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789607743.559089:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607743.559606:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140288:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789607743.559634:0:21912:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789607743.559654:0:21912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefa9 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.559671:0:21912:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefa9 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607743.559679:0:21912:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d78c2f72000 10000000:01000000:0.0:1789607743.559684:0:21912:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789607743.559688:0:21912:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d78c2f72000 10000000:01000000:0.0:1789607743.559690:0:21912:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789607743.559693:0:21912:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d78c2f72000 from 1 10000000:01000000:0.0:1789607743.559696:0:21912:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789607743.559719:0:21912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65600/0xa26202d240fbefb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.559727:0:21912:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65600/0xa26202d240fbefb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.559735:0:21912:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65600/0xa26202d240fbefb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607743.559749:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789607743.559784:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607743.559805:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c35040c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.560443:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150140416 00000100:00100000:2.0:1789607743.560452:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150140416 00000100:00100000:2.0:1789607743.560500:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607743.560508:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+6:21912:x1876539150140416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607743.560522:0:21923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607743.560536:0:21923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c0031200/0xa26202d240fbefb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbefb0 expref: -99 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.560556:0:21923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c0031200/0xa26202d240fbefb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbefb0 expref: 7 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.560577:0:21923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c0031200/0xa26202d240fbefb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbefb0 expref: 7 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.560592:0:21923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c0031200, rc 0) 00000100:00100000:2.0:1789607743.560632:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+7:21912:x1876539150140416:12345-0@lo:101:mount.lustre.0 Request processed in 125us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607743.560638:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789607743.560791:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607743.560805:0:21912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65600/0xa26202d240fbefb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefb7 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.560814:0:21912:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65600/0xa26202d240fbefb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbefb7 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607743.560840:0:21912:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789607743.560856:0:21912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65600/0xa26202d240fbefb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefb7 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.560895:0:21912:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65600/0xa26202d240fbefb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefb7 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607743.560902:0:21912:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789607743.560905:0:21912:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789607743.560910:0:21912:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d78c2f72000 10000000:01000000:0.0:1789607743.560912:0:21912:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789607743.560916:0:21912:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789607743.560925:0:21912:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789607743.560943:0:21912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64a00/0xa26202d240fbefbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.560950:0:21912:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64a00/0xa26202d240fbefbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.560957:0:21912:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64a00/0xa26202d240fbefbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607743.560972:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789607743.561014:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607743.561397:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c35040c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.561530:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150140544 00000100:00100000:2.0:1789607743.561536:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150140544 00000100:00100000:2.0:1789607743.561578:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607743.561586:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+7:21912:x1876539150140544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607743.561595:0:21923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607743.561605:0:21923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbefc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbefbe expref: -99 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.561623:0:21923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbefc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbefbe expref: 8 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.561632:0:21923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c0030c00/0xa26202d240fbefc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbefbe expref: 8 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.561639:0:21923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c0030c00, rc 0) 00000100:00100000:2.0:1789607743.561686:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+8:21912:x1876539150140544:12345-0@lo:101:mount.lustre.0 Request processed in 101us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607743.561692:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607743.561767:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607743.561779:0:21912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64a00/0xa26202d240fbefbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefc5 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607743.561787:0:21912:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64a00/0xa26202d240fbefbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbefc5 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607743.561838:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607743.561905:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607743.561933:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e07b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1789607743.562377:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150140672 00000100:00100000:0.0:1789607743.562382:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150140672 00000100:00100000:0.0:1789607743.562409:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607743.562426:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+8:21912:x1876539150140672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607743.562802:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+9:21912:x1876539150140672:12345-0@lo:501:mount.lustre.0 Request processed in 376us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607743.562810:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607743.563462:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607743.563514:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607743.563572:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607743.563601:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e07b3600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.563689:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150140800 00000100:00100000:2.0:1789607743.563695:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150140800 00000100:00100000:2.0:1789607743.563734:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607743.563742:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+9:21912:x1876539150140800:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607743.564387:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+9:21912:x1876539150140800:12345-0@lo:503:mount.lustre.0 Request processed in 645us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607743.564401:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789607743.564761:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150140800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607743.565602:0:21948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21948:1876539150140928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607743.565655:0:21948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607743.565692:0:21948:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e07b3600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.565796:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150140928 00000100:00100000:2.0:1789607743.565802:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150140928 00000100:00100000:2.0:1789607743.565852:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789607743.565887:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+9:21948:x1876539150140928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607743.566785:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+9:21948:x1876539150140928:12345-0@lo:502:llog_process_th.0 Request processed in 919us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607743.566794:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607743.567433:0:21948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21948:1876539150140928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789607743.567467:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607743.567477:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607743.567479:0:21948:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789607743.567485:0:21948:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789607743.567487:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789607743.567503:0:21948:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d77c41919c0) 00000020:00000080:1.0:1789607743.567519:0:21948:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789607743.567523:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789607743.567657:0:21948:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789607743.567664:0:21948:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbefd3 00000020:00000080:1.0:1789607743.568387:0:21948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789607743.568393:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607743.568399:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607743.568401:0:21948:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789607743.568403:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607743.568407:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607743.568408:0:21948:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789607743.568411:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789607743.568421:0:21948:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d77c4190000) 00000020:00000080:1.0:1789607743.568431:0:21948:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789607743.568446:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789607743.568448:0:21948:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789607743.568450:0:21948:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789607743.568456:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789607743.568504:0:21948:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78c2f72000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789607743.568517:0:21948:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d77c4193380) 00000020:00000080:1.0:1789607743.568529:0:21948:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789607743.568635:0:21948:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789607743.568642:0:21948:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbefe8 00000020:00000080:1.0:1789607743.568730:0:21948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789607743.568736:0:21948:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789607743.568739:0:21948:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa26202d240fbefef 00080000:01000000:1.0:1789607743.568744:0:21948:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789607743.568746:0:21948:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbeff6 00010000:00010000:3.0:1789607743.687016:0:21948:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789607743.691731:0:21948:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:3.0:1789607743.692492:0:21948:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789607743.693063:0:21948:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d78f9d299c0) 00000020:00000080:3.0:1789607743.693082:0:21948:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789607743.693155:0:21948:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789607743.693163:0:21948:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbf004 00000020:00000080:2.0:1789607743.698780:0:21948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789607743.707450:0:21948:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa26202d240fbf00b 00000020:00000080:0.0:1789607743.713877:0:21948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789607743.713894:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607743.713903:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607743.713906:0:21948:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789607743.713924:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789607743.713927:0:21948:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789607743.713929:0:21948:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789607743.713930:0:21948:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789607743.713931:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789607743.713934:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607743.713935:0:21948:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789607743.713938:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607743.713942:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607743.713943:0:21948:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789607743.713948:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789607743.714169:0:21948:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789607743.714211:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607743.714215:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607743.714216:0:21948:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789607743.714220:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607743.714223:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607743.714225:0:21948:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789607743.714227:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789607743.714232:0:21948:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:00000080:0.0:1789607743.714259:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789607743.714274:0:21948:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8d78e9ee8000) 00000020:00000080:0.0:1789607743.714289:0:21948:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789607743.714295:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789607743.714360:0:21948:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789607743.714365:0:21948:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789607743.714372:0:21948:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbf019 00010000:00080000:0.0:1789607743.714402:0:21948:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78c7d23800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:0.0:1789607743.716135:0:21948:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1789607743.717828:0:21948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789607743.717843:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789607743.718060:0:21948:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789607743.718084:0:21948:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbf020 00000100:00080000:2.0:1789607743.718094:0:21948:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607743.718105:0:21948:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d78c7d23800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607743.718150:0:21948:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78c61fc380 x1876539150141056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607743.718230:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150141056:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789607743.718315:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789607743.718487:0:21948:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1789607743.718539:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607743.718543:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607743.718545:0:21948:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789607743.718548:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789607743.718551:0:21948:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1789607743.718552:0:21948:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607743.718554:0:21948:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607743.718555:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789607743.718557:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607743.718565:0:21948:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789607743.718568:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789607743.718573:0:21948:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789607743.718576:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607743.718577:0:21948:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789607743.718579:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789607743.718583:0:21948:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:2.0:1789607743.718602:0:21948:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789607743.718604:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607743.718616:0:21948:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d78c5b90000) 00000020:00000080:2.0:1789607743.718629:0:21948:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789607743.718633:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789607743.718688:0:21948:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789607743.718693:0:21948:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789607743.718699:0:21948:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbf02e 00010000:00080000:2.0:1789607743.718736:0:21948:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78fcd69000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1789607743.719386:0:21948:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789607743.719745:0:21948:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789607743.719786:0:21948:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1789607743.721094:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150141056 00000100:00100000:3.0:1789607743.721106:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150141056 00000100:00100000:3.0:1789607743.721348:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607743.721356:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3467:x1876539150141056:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789607743.721377:0:21935:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:2.0:1789607743.722643:0:21948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607743.722724:0:21948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1789607743.722806:0:21948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1789607743.724578:0:21954:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789607743.724585:0:21954:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789607743.726604:0:21948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789607743.726619:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789607743.726657:0:21948:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789607743.726677:0:21948:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbf035 00000100:00080000:0.0:1789607743.726688:0:21948:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607743.726698:0:21948:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d78fcd69000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607743.726732:0:21948:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78ff79c000 x1876539150141184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607743.726762:0:21948:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789607743.726882:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607743.726887:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607743.726889:0:21948:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789607743.726893:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789607743.726896:0:21948:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1789607743.726897:0:21948:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789607743.726899:0:21948:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789607743.726900:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789607743.726902:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607743.726904:0:21948:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789607743.726915:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789607743.726920:0:21948:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789607743.726934:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607743.726936:0:21948:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789607743.726939:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789607743.726942:0:21948:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:0.0:1789607743.726961:0:21948:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789607743.726963:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789607743.726974:0:21948:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d78e9eeb380) 00000020:00000080:0.0:1789607743.726985:0:21948:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789607743.726991:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789607743.727067:0:21948:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789607743.727073:0:21948:0:(osd_handler.c:1574:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789607743.727079:0:21948:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa26202d240fbf043 00010000:00080000:0.0:1789607743.727119:0:21948:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78c7c35800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:0.0:1789607743.728474:0:21948:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789607743.728648:0:21948:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789607743.728671:0:21948:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1789607743.729427:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150141184:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789607743.729487:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150141184 offset 0 length 520: 4 00000040:00080000:0.0:1789607743.730695:0:21948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607743.730776:0:21948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789607743.730846:0:21948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1789607743.738722:0:21956:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789607743.738728:0:21956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789607743.741474:0:21948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789607743.741490:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789607743.741531:0:21948:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789607743.741769:0:21948:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbf04a 00000100:00080000:1.0:1789607743.741780:0:21948:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789607743.741792:0:21948:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d78c7c35800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607743.741830:0:21948:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cf7c6d80 x1876539150141312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607743.741859:0:21948:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789607743.741907:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150141312:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789607743.742352:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150141312 offset 0 length 520: 4 00000020:01000000:0.0:1789607743.743660:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607743.743668:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607743.743670:0:21948:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789607743.743674:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607743.743678:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607743.743679:0:21948:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789607743.743682:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789607743.743684:0:21948:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789607743.743686:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607743.743688:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607743.743689:0:21948:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789607743.743692:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607743.743694:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607743.743695:0:21948:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789607743.743715:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789607743.743759:0:21948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21948:1876539150141440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607743.743826:0:21948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607743.743879:0:21948:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c801a000 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.745182:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150141440 00000100:00100000:2.0:1789607743.745195:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150141440 00000100:00100000:2.0:1789607743.745243:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789607743.745253:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+9:21948:x1876539150141440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607743.745544:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+9:21948:x1876539150141440:12345-0@lo:502:llog_process_th.0 Request processed in 291us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607743.745552:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789607743.745672:0:21948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21948:1876539150141440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789607743.745707:0:21948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607743.745713:0:21948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607743.745715:0:21948:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789607743.745719:0:21948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789607743.745892:0:21912:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789607743.745918:0:21912:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789607743.745933:0:21912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64a00/0xa26202d240fbefbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefc5 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607743.745944:0:21912:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64a00/0xa26202d240fbefbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefc5 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607743.745959:0:21912:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78c2f72000 from 1 10000000:01000000:1.0:1789607743.745963:0:21912:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789607743.745993:0:21912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607743.746013:0:21912:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607743.746022:0:21912:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607743.746042:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150141568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789607743.746085:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607743.746112:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.746744:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150141568 00000100:00100000:2.0:1789607743.746751:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150141568 00000100:00100000:2.0:1789607743.746798:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607743.746806:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+9:21912:x1876539150141568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607743.746818:0:21925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607743.746832:0:21925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c0030400/0xa26202d240fbf058 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf051 expref: -99 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.746878:0:21925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c0030400/0xa26202d240fbf058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf051 expref: 10 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.746890:0:21925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c0030400/0xa26202d240fbf058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf051 expref: 10 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.746899:0:21925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c0030400, rc 0) 00000100:00100000:2.0:1789607743.746959:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+10:21912:x1876539150141568:12345-0@lo:101:mount.lustre.0 Request processed in 153us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607743.746965:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789607743.746986:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150141568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607743.747012:0:21912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf058 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.747022:0:21912:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf058 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607743.749088:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150141696:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789607743.749162:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607743.750344:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0e48c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.755100:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150141696 00000100:00100000:2.0:1789607743.755117:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150141696 00000100:00100000:0.0:1789607743.757969:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789607743.757984:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+10:21912:x1876539150141696:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789607743.758023:0:21923:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789607743.758030:0:21923:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789607743.758154:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+10:21912:x1876539150141696:12345-0@lo:256:mount.lustre.0 Request processed in 173us (8991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607743.758162:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789607743.758514:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150141696:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789607743.759199:0:21912:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:2.0:1789607743.759575:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3467:x1876539150141056:12345-0@lo:38:llog_process_th.0 Request processed in 38216us (41258us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789607743.759591:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789607743.761340:0:21912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf058 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607743.761355:0:21912:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf058 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607743.761362:0:21912:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78c2f72000 from 1 10000000:01000000:1.0:1789607743.761365:0:21912:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00080000:3.0:1789607743.761397:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c7d23800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00010000:00010000:1.0:1789607743.761402:0:21912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607743.761411:0:21912:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789607743.761414:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789607743.761419:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150141056:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1789607743.761431:0:21912:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607743.761451:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150141824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789607743.761509:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607743.761558:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.763741:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150141824 00000100:00100000:2.0:1789607743.763755:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150141824 00000100:00100000:2.0:1789607743.763834:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789607743.763845:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+10:21912:x1876539150141824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607743.763888:0:21925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607743.763915:0:21925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c0030e00/0xa26202d240fbf066 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf05f expref: -99 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.763944:0:21925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c0030e00/0xa26202d240fbf066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf05f expref: 11 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.763954:0:21925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c0030e00/0xa26202d240fbf066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf05f expref: 11 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.763963:0:21925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c0030e00, rc 0) 00000100:00100000:2.0:1789607743.764043:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+11:21912:x1876539150141824:12345-0@lo:101:mount.lustre.0 Request processed in 199us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607743.764049:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607743.764231:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150141824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607743.764248:0:21912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf066 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607743.764257:0:21912:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf066 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607743.764323:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150141952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607743.764357:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607743.764382:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.765653:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150141952 00000100:00100000:2.0:1789607743.765668:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150141952 00000100:00100000:2.0:1789607743.765724:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607743.765732:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+11:21912:x1876539150141952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607743.766611:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+11:21912:x1876539150141952:12345-0@lo:501:mount.lustre.0 Request processed in 876us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607743.766620:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789607743.768136:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150141952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607743.768322:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150142080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607743.768395:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607743.768472:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607743.771658:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150142080 00000100:00100000:3.0:1789607743.771672:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150142080 00000100:00100000:0.0:1789607743.771842:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789607743.771884:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+11:21912:x1876539150142080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607743.772159:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+11:21912:x1876539150142080:12345-0@lo:503:mount.lustre.0 Request processed in 277us (3763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607743.772167:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789607743.772436:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150142080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607743.772951:0:21958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21958:1876539150142208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607743.773014:0:21958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607743.773479:0:21958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f313c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607743.773570:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150142208 00000100:00100000:3.0:1789607743.773577:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150142208 00000100:00100000:3.0:1789607743.773609:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789607743.773617:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+11:21958:x1876539150142208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607743.773885:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+11:21958:x1876539150142208:12345-0@lo:502:llog_process_th.0 Request processed in 267us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607743.773892:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789607743.774145:0:21958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21958:1876539150142208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789607743.774175:0:21958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607743.774194:0:21958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607743.774196:0:21958:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789607743.774213:0:21958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78c2f72000 00000020:00000080:1.0:1789607743.774216:0:21958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607743.774224:0:21958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607743.774226:0:21958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607743.774228:0:21958:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789607743.774230:0:21958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607743.774233:0:21958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607743.774234:0:21958:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789607743.774237:0:21958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d78c2f72000 00000020:00000080:1.0:1789607743.774239:0:21958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607743.774291:0:21958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607743.776792:0:21958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607743.776799:0:21958:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789607743.776809:0:21958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607743.776814:0:21958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607743.776815:0:21958:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789607743.776820:0:21958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78c2f72000 00000020:00000080:1.0:1789607743.776823:0:21958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607743.777070:0:21958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607743.777075:0:21958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607743.777076:0:21958:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789607743.777079:0:21958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607743.777082:0:21958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607743.777083:0:21958:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789607743.777087:0:21958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d78c2f72000 00000020:00000080:1.0:1789607743.777089:0:21958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789607743.786414:0:21958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21958:1876539150142336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607743.786505:0:21958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607743.786553:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150142336 00000100:00100000:1.0:1789607743.786560:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150142336 00000100:00100000:1.0:1789607743.786603:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789607743.786613:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+11:21958:x1876539150142336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607743.786834:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+11:21958:x1876539150142336:12345-0@lo:502:llog_process_th.0 Request processed in 222us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607743.786842:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789607743.788979:0:21958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607743.789153:0:21958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21958:1876539150142336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789607743.789337:0:21958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607743.789347:0:21958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607743.789350:0:21958:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789607743.789355:0:21958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789607743.789533:0:21912:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789607743.789555:0:21912:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607743.789576:0:21912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf066 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607743.789588:0:21912:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf066 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607743.789634:0:21912:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789607743.789637:0:21912:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d78c2f72000 10000000:01000000:3.0:1789607743.789640:0:21912:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d78c2f72000 10000000:01000000:3.0:1789607743.789644:0:21912:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789607743.789649:0:21912:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d78c2f72000 from 1 10000000:01000000:3.0:1789607743.789652:0:21912:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789607743.789685:0:21912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbf06d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607743.789694:0:21912:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbf06d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607743.789704:0:21912:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbf06d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607743.789722:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150142464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789607743.789781:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607743.789811:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.789902:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150142464 00000100:00100000:2.0:1789607743.789962:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150142464 00000100:00100000:2.0:1789607743.790076:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789607743.790086:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+11:21912:x1876539150142464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607743.790100:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607743.790117:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59dc00/0xa26202d240fbf074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf06d expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.790140:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59dc00/0xa26202d240fbf074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf06d expref: 12 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.790150:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59dc00/0xa26202d240fbf074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf06d expref: 12 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.790158:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59dc00, rc 0) 00000100:00100000:2.0:1789607743.791123:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+12:21912:x1876539150142464:12345-0@lo:101:mount.lustre.0 Request processed in 1035us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607743.791132:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789607743.792087:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150142464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607743.792110:0:21912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbf06d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf074 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607743.792122:0:21912:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbf06d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf074 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607743.792270:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150142592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607743.792320:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607743.792351:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0900 going to sleep for 11 seconds 00000100:00100000:1.0:1789607743.792519:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150142592 00000100:00100000:1.0:1789607743.792526:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150142592 00000100:00100000:1.0:1789607743.792562:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607743.792571:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+12:21912:x1876539150142592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607743.793487:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+12:21912:x1876539150142592:12345-0@lo:501:mount.lustre.0 Request processed in 914us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607743.793497:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789607743.793589:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150142592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607743.793630:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150142720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607743.793669:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607743.793699:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.793817:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150142720 00000100:00100000:2.0:1789607743.793822:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150142720 00000100:00100000:2.0:1789607743.793928:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607743.793937:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+12:21912:x1876539150142720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607743.794355:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+12:21912:x1876539150142720:12345-0@lo:503:mount.lustre.0 Request processed in 418us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607743.794362:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789607743.795316:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150142720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607743.799769:0:21963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21963:1876539150142848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607743.799842:0:21963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607743.799897:0:21963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c34f03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.799984:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150142848 00000100:00100000:2.0:1789607743.800294:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150142848 00000100:00100000:2.0:1789607743.800340:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789607743.800348:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+12:21963:x1876539150142848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607743.800564:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+12:21963:x1876539150142848:12345-0@lo:502:llog_process_th.0 Request processed in 217us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607743.800572:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789607743.800621:0:21963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21963:1876539150142848:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789607743.800675:0:21963:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789607743.800689:0:21963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d78ef163380) 00000020:00000080:2.0:1789607743.800705:0:21963:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789607743.800768:0:21963:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d78c2f72000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789607743.800771:0:21963:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d78c2f72000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789607743.800774:0:21963:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d78c2f72000 4 00010000:00080000:2.0:1789607743.800798:0:21963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d77c4d65000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1789607743.808403:0:21963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789607743.808835:0:21963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789607743.808887:0:21963:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789607743.808898:0:21963:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa26202d240fbf082 00000100:00080000:2.0:1789607743.808907:0:21963:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607743.808918:0:21963:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d77c4d65000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607743.808949:0:21963:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78c61fd880 x1876539150142976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607743.808981:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539150142976:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789607743.809045:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789607743.809100:0:21963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789607743.810343:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150142976 00000100:00100000:1.0:1789607743.810354:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150142976 00000100:00100000:1.0:1789607743.810388:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607743.810396:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539150142976:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789607743.810475:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3467:x1876539150142976:12345-0@lo:38:llog_process_th.0 Request processed in 79us (1430us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789607743.810482:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607743.811502:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789607743.811513:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c4d65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607743.811518:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789607743.811523:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539150142976:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789607743.811643:0:21963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21963:1876539150143104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607743.811701:0:21963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607743.811721:0:21963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb1900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.811738:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150143104 00000100:00100000:2.0:1789607743.811750:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150143104 00000100:00100000:2.0:1789607743.811782:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789607743.811790:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+12:21963:x1876539150143104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607743.812685:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+12:21963:x1876539150143104:12345-0@lo:502:llog_process_th.0 Request processed in 891us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607743.812695:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789607743.812751:0:21963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21963:1876539150143104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607743.812803:0:21963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21963:1876539150143232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607743.812841:0:21963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607743.812890:0:21963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb1900 going to sleep for 11 seconds 00000100:00100000:1.0:1789607743.815341:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150143232 00000100:00100000:1.0:1789607743.815355:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150143232 00000100:00100000:1.0:1789607743.815412:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607743.815422:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+12:21963:x1876539150143232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607743.815662:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+12:21963:x1876539150143232:12345-0@lo:502:llog_process_th.0 Request processed in 240us (2818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607743.815670:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789607743.815766:0:21963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77c69b89-f077-4f20-ab40-68d85082562e:21963:1876539150143232:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789607743.815799:0:21963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789607743.815936:0:21912:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789607743.815954:0:21912:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789607743.815970:0:21912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbf06d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf074 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.815981:0:21912:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9800/0xa26202d240fbf06d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf074 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789607743.818153:0:21912:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789607743.818157:0:21912:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789607743.818158:0:21912:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607743.818160:0:21912:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607743.818161:0:21912:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607743.818163:0:21912:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607743.818164:0:21912:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607743.818166:0:21912:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789607743.818168:0:21912:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607743.818173:0:21912:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789607743.818177:0:21912:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789607743.818188:0:21912:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789607743.818190:0:21912:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789607743.818191:0:21912:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607743.818191:0:21912:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607743.818192:0:21912:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607743.818193:0:21912:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607743.818194:0:21912:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607743.818195:0:21912:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789607743.818196:0:21912:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607743.818197:0:21912:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789607743.818293:0:21912:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789607743.818312:0:21912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150143360:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789607743.818374:0:21912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607743.818407:0:21912:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb1900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607743.818443:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150143360 00000100:00100000:2.0:1789607743.818449:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150143360 00000100:00100000:2.0:1789607743.818496:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789607743.818505:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+12:21912:x1876539150143360:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789607743.818544:0:21923:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789607743.818557:0:21923:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789607743.913351:0:21923:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789607743.913363:0:21923:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789607743.913737:0:21946:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789607743.913743:0:21946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789607743.913764:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.913781:0:21946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c0030400/0xa26202d240fbf058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf051 expref: 12 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.913790:0:21946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.913828:0:21946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c0030400/0xa26202d240fbf058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbf051 expref: 12 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.913854:0:21946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78c0030400/0xa26202d240fbf058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbf051 expref: 12 pid: 21925 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607743.913896:0:21946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150143488:0@lo:104: 00000100:00100000:2.0:1789607743.914182:0:21946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607743.914271:0:21946:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789607743.914386:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150143488 00000100:00100000:0.0:1789607743.914394:0:21913:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150143488 00000100:00100000:0.0:1789607743.914433:0:21913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789607743.914441:0:21913:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77c69b89-f077-4f20-ab40-68d85082562e+3:21946:x1876539150143488:12345-0@lo:104: 00010000:00010000:0.0:1789607743.914453:0:21913:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf058 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.914507:0:21913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789607743.914513:0:21913:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77c69b89-f077-4f20-ab40-68d85082562e+3:21946:x1876539150143488:12345-0@lo:104: Request processed in 73us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607743.914520:0:21913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789607743.914560:0:21946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150143488:0@lo:104: 00010000:00010000:0.0:1789607743.914578:0:21946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.914595:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607743.914600:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf058 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.914606:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607743.914610:0:21919:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbf058 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.914630:0:21919:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbf058 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607743.914637:0:21919:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbf058 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607743.914642:0:21919:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789607743.914669:0:21919:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf058 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.914675:0:21919:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607743.914692:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf058 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.914699:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf058 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.914712:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607743.914714:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607743.914715:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607743.914741:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150143616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607743.914767:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607743.914817:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150143616 00000100:00100000:0.0:1789607743.914821:0:21915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150143616 00010000:00010000:0.0:1789607743.914836:0:21915:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c0030400/0xa26202d240fbf058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf051 expref: 13 pid: 21925 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607743.914857:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789607743.914895:0:21915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77c69b89-f077-4f20-ab40-68d85082562e+13:3468:x1876539150143616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607743.914912:0:21915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607743.917605:0:21915:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c0030400/0xa26202d240fbf058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf051 expref: 13 pid: 21925 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.917630:0:21915:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c0030400/0xa26202d240fbf058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbf051 expref: 13 pid: 21925 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.917650:0:21915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c0030400/0xa26202d240fbf058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbf051 expref: 13 pid: 21925 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.917675:0:21915:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.917683:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789607743.917700:0:21915:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003957264s 00010000:00010000:0.0:1789607743.917705:0:21915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.917712:0:21915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.917719:0:21915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.917726:0:21915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.917732:0:21915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59cc00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607743.917736:0:21915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.917757:0:21915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.917770:0:21915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607743.917780:0:21915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607743.917880:0:21915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77c69b89-f077-4f20-ab40-68d85082562e+12:3468:x1876539150143616:12345-0@lo:103:ldlm_bl.0 Request processed in 2963us (3088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607743.917891:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789607743.918123:0:21946:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.918132:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607743.918139:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59cc00/0xa26202d240fbf089 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607743.918932:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150143616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607743.926197:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+11:21912:x1876539150143360:12345-0@lo:253:mount.lustre.0 Request processed in 107682us (107811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607743.926288:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789607743.926449:0:21912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:21912:1876539150143360:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789607743.926463:0:21912:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789607743.926467:0:21912:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607743.926469:0:21912:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789607743.926470:0:21912:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607743.926472:0:21912:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607743.926473:0:21912:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607743.926474:0:21912:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607743.926475:0:21912:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607743.926477:0:21912:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789607743.926479:0:21912:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607743.926480:0:21912:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789607743.926495:0:21912:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789607743.932161:0:21912:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607743.932403:0:21912:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607743.932670:0:21912:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607743.932829:0:21912:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607743.933449:0:21912:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607743.933608:0:21912:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607743.935106:0:21912:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607743.935342:0:21912:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607743.935614:0:21912:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607743.939493:0:21912:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607743.939826:0:21912:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607743.940465:0:21912:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789607743.979426:0:21912:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1789607743.980360:0:21912:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789607743.980521:0:21971:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1789607743.980525:0:21971:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:3.0:1789607743.980642:0:21972:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1789607743.980718:0:21972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1789607743.981062:0:21912:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1789607743.981509:0:21973:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8d78cf7c5180 x1876539150143744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607743.981522:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00000040:00080000:3.0:1789607743.986342:0:21972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789607743.986420:0:21972:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1789607743.987611:0:21912:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789607743.987736:0:21912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789607743.988480:0:21912:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789607743.988492:0:21912:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789607743.988651:0:21912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607743.990354:0:21912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789607743.991288:0:21912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789607743.991331:0:21912:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789607743.991794:0:21912:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1789607743.993442:0:21912:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:1.0:1789607744.006444:0:21912:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1789607744.048603:0:21912:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789607744.048648:0:21912:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa81b01463988 00100000:10000000:1.0:1789607744.048656:0:21912:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789607744.049744:0:21912:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789607744.049760:0:21912:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789607744.050070:0:21912:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789607744.050095:0:21912:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789607744.418992:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789607744.867331:0:21964:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789607744.867347:0:21964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607744.867687:0:21964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789607744.867693:0:21964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789607744.994026:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 10000000:01000000:0.0:1789607745.121914:0:21927:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789607745.121921:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78c2f72000 from 11 10000000:01000000:0.0:1789607745.121927:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789607745.121969:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607745.121982:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607745.121993:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607745.122016:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150143872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789607745.124282:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607745.124325:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370240 going to sleep for 11 seconds 00000100:00100000:1.0:1789607745.126296:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150143872 00000100:00100000:1.0:1789607745.126312:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150143872 00000100:00100000:1.0:1789607745.126363:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607745.126373:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+11:21927:x1876539150143872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607745.126389:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607745.126409:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fcf76200/0xa26202d240fbf097 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf090 expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607745.126438:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fcf76200/0xa26202d240fbf097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf090 expref: 12 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607745.126449:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fcf76200/0xa26202d240fbf097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf090 expref: 12 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607745.126458:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf76200, rc 0) 00000100:00100000:1.0:1789607745.126525:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+12:21927:x1876539150143872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (2246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607745.126532:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607745.126586:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150143872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607745.126602:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf097 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607745.126612:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf097 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607745.126678:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150144000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789607745.126712:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607745.126736:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ec2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607745.128177:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150144000 00000100:00100000:2.0:1789607745.128189:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150144000 00000100:00100000:2.0:1789607745.128235:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789607745.128244:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+12:21927:x1876539150144000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789607745.128264:0:21923:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789607745.128280:0:21923:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789607745.128283:0:21923:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1789607745.128451:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+12:21927:x1876539150144000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 208us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607745.128458:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789607745.128842:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150144000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789607745.128903:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789607745.128911:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf097 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607745.128922:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf097 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607745.442132:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789607745.890271:0:21964:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789607745.890280:0:21964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607745.890627:0:21964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1789607745.890677:0:21964:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607745.890704:0:21964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:1.0:1789607746.017946:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00010000:00010000:1.0:1789607746.466047:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607747.042215:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00010000:00010000:0.0:1789607747.490461:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607748.068096:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00000001:02000400:2.0:1789607748.316408:0:22217:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789607748.515027:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789607748.834134:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789607748.834143:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789607748.834148:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78c7d23800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607748.834159:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:1.0:1789607748.834175:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789607748.834191:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d78c7d23800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607748.834223:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cf7c7b80 x1876539150144256/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607748.834253:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607748.834257:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789607748.834260:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607748.834263:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789607748.834266:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:2.0:1789607748.835277:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607748.835304:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150144128:0@lo:400:kworker.0 00000100:00100000:2.0:1789607748.835398:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607748.837266:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150144256:0@lo:38:kworker.0 00000100:00100000:0.0:1789607748.837404:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789607748.837933:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789607748.837938:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d77c4d65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607748.837949:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d77c4d65000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607748.837979:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cf7c4a80 x1876539150144384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607748.838111:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150144128 00000100:00100000:1.0:1789607748.838118:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150144128 00000100:00100000:0.0:1789607748.838146:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539150144384:0@lo:38:kworker.0 00000100:00100000:1.0:1789607748.838169:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607748.838180:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+12:3468:x1876539150144128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607748.838191:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607748.838244:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+12:3468:x1876539150144128:12345-0@lo:400:kworker.0 Request processed in 66us (2847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607748.838251:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607748.838305:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150144128:0@lo:400:kworker.0 00000100:00100000:2.0:1789607748.838712:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150144256 00000100:00100000:2.0:1789607748.838737:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150144256 00000100:00100000:2.0:1789607748.838773:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607748.838782:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3467:x1876539150144256:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789607748.838805:0:21936:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789607748.838916:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3467:x1876539150144256:12345-0@lo:38:kworker.0 Request processed in 133us (1511us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789607748.838923:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607748.838962:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150144384 00000100:00100000:2.0:1789607748.838967:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150144384 00000100:00080000:1.0:1789607748.839927:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c7d23800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607748.839939:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789607748.839944:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150144256:0@lo:38:kworker.0 00000100:00100000:2.0:1789607748.847072:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607748.847083:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3467:x1876539150144384:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789607748.847119:0:21932:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:2.0:1789607748.847231:0:21932:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa26202d240fbf09e 00000004:00100000:2.0:1789607748.847249:0:21932:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789607748.847385:0:21932:0:(import.c:65:import_set_state_nolock()) ffff8d78fd2df800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607748.847478:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3467:x1876539150144384:12345-0@lo:38:kworker.0 Request processed in 394us (9285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607748.847485:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789607748.848106:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d78cf7c4a80 x1876539150144384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789607748.848138:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789607748.848147:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789607748.848152:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789607748.848154:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c4d65000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789607748.848161:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3467:1876539150144384:0@lo:38:kworker.0 00000100:00100000:2.0:1789607749.098429:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00010000:00010000:0.0:1789607749.538049:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607750.115481:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00010000:00010000:2.0:1789607750.574230:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607751.148778:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00010000:00010000:0.0:1789607751.587269:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607752.171116:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00010000:00010000:2.0:1789607752.610308:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607753.191760:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00010000:00010000:0.0:1789607753.638362:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789607753.954141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789607753.954150:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789607753.954154:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78c7d23800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607753.954163:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 653 00000100:00080000:1.0:1789607753.954171:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789607753.954186:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d78c7d23800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607753.954216:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cf7c7b80 x1876539150144640/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607753.954235:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607753.954239:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789607753.954243:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607753.954246:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789607753.954313:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150144768:0@lo:400:kworker.0 00000100:00100000:1.0:1789607753.955285:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607753.955439:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607753.955452:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77c69b89-f077-4f20-ab40-68d85082562e:3471:1876539150144512:0@lo:400:kworker.0 00000100:00100000:1.0:1789607753.955498:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607753.955557:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607743/real 1789607743] req@ffff8d78cf7c6d80 x1876539150141312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607753 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607753.955583:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78cf7c6d80 x1876539150141312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607753 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607753.955595:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607743/real 1789607743] req@ffff8d78ff79c000 x1876539150141184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607753 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607753.955607:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78ff79c000 x1876539150141184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607753 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607753.955620:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150144640:0@lo:38:kworker.0 00000100:00100000:1.0:1789607753.955651:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789607753.955676:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c7c35800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607753.955691:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789607753.955695:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150141312:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789607753.955701:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fcd69000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607753.955707:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789607753.955710:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150141184:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789607753.955761:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150144768 00000100:00100000:1.0:1789607753.955771:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150144768 00000100:00100000:1.0:1789607753.955832:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607753.955843:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150144768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607753.955925:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150144768:12345-0@lo:400:kworker.0 Request processed in 84us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607753.955932:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607753.955960:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150144512 00000100:00100000:1.0:1789607753.955971:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150144512 00000100:00100000:1.0:1789607753.956013:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607753.956020:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+12:3471:x1876539150144512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607753.956065:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+12:3471:x1876539150144512:12345-0@lo:400:kworker.0 Request processed in 46us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607753.956071:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607753.956106:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150144640 00000100:00100000:1.0:1789607753.956110:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150144640 00000100:00100000:1.0:1789607753.959181:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607753.959208:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3467:x1876539150144640:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789607753.959236:0:21936:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789607753.959364:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3467:x1876539150144640:12345-0@lo:38:kworker.0 Request processed in 163us (3711us total) trans 0 rc -19/-19 00000100:00080000:0.0:1789607753.961285:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607753.961295:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789607753.961300:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78fcd69000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607753.961309:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:0.0:1789607753.961316:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789607753.961329:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d78fcd69000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607753.961381:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78ff79f480 x1876539150144896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607753.961400:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607753.961403:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789607753.961404:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78c7c35800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607753.961407:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:0.0:1789607753.961410:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789607753.961414:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d78c7c35800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607753.961424:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78ff79ca80 x1876539150145024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607753.961481:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77c69b89-f077-4f20-ab40-68d85082562e:3471:1876539150144512:0@lo:400:kworker.0 00010000:00080000:0.0:1789607753.961498:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d78cf7c5c00 x1876539150144768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607753.961525:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150144768:0@lo:400:kworker.0 00000100:00100000:1.0:1789607753.964091:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607753.964184:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150144896:0@lo:8:kworker.0 00000400:00000100:1.0:1789607753.964272:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150144896 offset 0 length 520: 4 00000100:00100000:1.0:1789607753.964322:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150145024:0@lo:8:kworker.0 00000400:00000100:1.0:1789607753.964476:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150145024 offset 0 length 520: 4 00000100:00080000:1.0:1789607753.964526:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c7d23800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607753.964532:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789607753.964537:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150144640:0@lo:38:kworker.0 00000100:00100000:2.0:1789607754.210139:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00010000:00010000:0.0:1789607754.670762:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789607755.117368:0:21964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789607755.234954:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00010000:00010000:2.0:1789607755.684799:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607756.259310:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00010000:00010000:2.0:1789607756.706307:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789607756.905805:0:22567:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789607756.905809:0:22567:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt2/mdt2 00000080:01200004:2.0:1789607756.906028:0:22567:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d77c610b000 00000020:01000004:2.0:1789607756.906044:0:22567:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-zfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789607756.906058:0:22567:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789607756.906071:0:22567:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8d78ef160000) 00000020:00000080:2.0:1789607756.906087:0:22567:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789607756.931499:0:22567:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789607756.931736:0:22567:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789607756.933357:0:22567:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000003:0x30:0x0] (8/32) 00100000:10000000:3.0:1789607756.933644:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-client under 455: rc = 0 00100000:10000000:3.0:1789607756.933760:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled params under 455: rc = 0 00100000:10000000:3.0:1789607756.933894:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-MDT0001 under 455: rc = 0 00100000:10000000:2.0:1789607756.944413:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000-MDT0001 under 568: rc = 0 00100000:10000000:2.0:1789607756.944721:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000 under 568: rc = 0 00100000:10000000:2.0:1789607756.945016:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000 under 568: rc = 0 00100000:10000000:2.0:1789607756.945295:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000 under 568: rc = 0 00100000:10000000:2.0:1789607756.948361:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000-MDT0001 under 568: rc = 0 00100000:10000000:2.0:1789607756.949619:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000-MDT0001 under 568: rc = 0 00100000:10000000:2.0:1789607756.949899:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000-MDT0001 under 568: rc = 0 00100000:10000000:2.0:1789607756.953025:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000 under 568: rc = 0 00100000:10000000:2.0:1789607756.953322:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000-MDT0001 under 568: rc = 0 00100000:10000000:2.0:1789607756.954788:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000 under 568: rc = 0 00100000:10000000:2.0:1789607756.955212:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000 under 568: rc = 0 00100000:10000000:2.0:1789607756.955463:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000-MDT0001 under 568: rc = 0 00100000:10000000:2.0:1789607756.958828:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_11 under 774: rc = 0 00100000:10000000:2.0:1789607756.959143:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_01 under 774: rc = 0 00100000:10000000:2.0:1789607756.959398:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_08 under 774: rc = 0 00100000:10000000:2.0:1789607756.959666:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_02 under 774: rc = 0 00100000:10000000:2.0:1789607756.959932:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_12 under 774: rc = 0 00100000:10000000:2.0:1789607756.960193:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_15 under 774: rc = 0 00100000:10000000:2.0:1789607756.960441:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_05 under 774: rc = 0 00100000:10000000:2.0:1789607756.962829:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_06 under 774: rc = 0 00100000:10000000:2.0:1789607756.963438:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_12 under 774: rc = 0 00100000:10000000:2.0:1789607756.963707:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_08 under 774: rc = 0 00100000:10000000:2.0:1789607756.966205:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_02 under 774: rc = 0 00100000:10000000:2.0:1789607756.966967:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_01 under 774: rc = 0 00100000:10000000:2.0:1789607756.967227:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_11 under 774: rc = 0 00100000:10000000:0.0:1789607756.974934:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_06 under 774: rc = 0 00100000:10000000:0.0:1789607756.975255:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_05 under 774: rc = 0 00100000:10000000:0.0:1789607756.975971:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_15 under 774: rc = 0 00100000:10000000:0.0:1789607756.976227:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_07 under 774: rc = 0 00100000:10000000:0.0:1789607756.976614:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_14 under 774: rc = 0 00100000:10000000:0.0:1789607756.977403:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_04 under 774: rc = 0 00100000:10000000:0.0:1789607756.977677:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_03 under 774: rc = 0 00100000:10000000:0.0:1789607756.977984:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_09 under 774: rc = 0 00100000:10000000:0.0:1789607756.978232:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_13 under 774: rc = 0 00100000:10000000:0.0:1789607756.978485:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_10 under 774: rc = 0 00100000:10000000:0.0:1789607756.978721:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_00 under 774: rc = 0 00100000:10000000:0.0:1789607756.979349:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_04 under 774: rc = 0 00100000:10000000:0.0:1789607756.980305:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_14 under 774: rc = 0 00100000:10000000:0.0:1789607756.981212:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_07 under 774: rc = 0 00100000:10000000:1.0:1789607756.986553:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_00 under 774: rc = 0 00100000:10000000:1.0:1789607756.987025:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_10 under 774: rc = 0 00100000:10000000:1.0:1789607756.987351:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_13 under 774: rc = 0 00100000:10000000:1.0:1789607756.990810:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_03 under 774: rc = 0 00100000:10000000:1.0:1789607756.991340:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_09 under 774: rc = 0 00100000:10000000:1.0:1789607756.991822:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000400:0x1:0x0] under 576: rc = 0 00100000:10000000:1.0:1789607756.992249:0:22567:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000401:0x1:0x0] under 576: rc = 0 00000020:00000080:1.0:1789607756.993041:0:22567:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1789607756.993055:0:22567:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789607756.993066:0:22567:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbf0ac 00000020:01000004:1.0:1789607756.993075:0:22567:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device lustre-mdt2/mdt2 00000020:01000004:1.0:1789607756.993096:0:22567:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.125@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789607756.993100:0:22567:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789607756.993106:0:22567:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1789607756.993125:0:22567:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt2/mdt2 10000000:01000000:1.0:1789607756.993129:0:22567:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789607757.036325:0:22567:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789607757.036374:0:22567:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.125@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1789607757.036378:0:22567:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789607757.036380:0:22567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789607757.036381:0:22567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607757.036383:0:22567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607757.036384:0:22567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607757.036385:0:22567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607757.036386:0:22567:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789607757.036388:0:22567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607757.036389:0:22567:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789607757.036393:0:22567:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1789607757.036395:0:22567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789607757.036397:0:22567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789607757.036398:0:22567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607757.036399:0:22567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607757.036400:0:22567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607757.036401:0:22567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607757.036402:0:22567:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789607757.036403:0:22567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607757.036404:0:22567:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789607757.036610:0:22567:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789607757.036632:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145152:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789607757.036709:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.036765:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1789607757.041988:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150145152 00000100:00100000:2.0:1789607757.042003:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150145152 00000100:00100000:2.0:1789607757.042100:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607757.042110:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+12:22567:x1876539150145152:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789607757.042181:0:21923:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789607757.042185:0:21923:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789607757.042192:0:21923:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789607757.091356:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+12:22567:x1876539150145152:12345-0@lo:253:mount.lustre.0 Request processed in 49239us (54637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607757.091369:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789607757.092274:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145152:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789607757.092292:0:22567:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789607757.092295:0:22567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789607757.092297:0:22567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789607757.092298:0:22567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607757.092300:0:22567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607757.092301:0:22567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607757.092303:0:22567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607757.092304:0:22567:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789607757.092306:0:22567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607757.092307:0:22567:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789607757.092330:0:22567:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d77c610b000 from lustre-MDT0001 10000000:01000000:1.0:1789607757.092361:0:22567:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789607757.092364:0:22567:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789607757.092371:0:22567:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d78c5b919c0 local copy 00010000:00010000:1.0:1789607757.092381:0:22567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefa9 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607757.092792:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607757.092843:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.092914:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607757.093710:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150145280 00000100:00100000:2.0:1789607757.093720:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150145280 00000100:00100000:2.0:1789607757.093773:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789607757.093784:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+12:22567:x1876539150145280:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607757.094050:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+12:22567:x1876539150145280:12345-0@lo:501:mount.lustre.0 Request processed in 267us (1206us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789607757.094057:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789607757.094391:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145280:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789607757.094413:0:22567:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789607757.096085:0:22567:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789607757.096099:0:22567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefa9 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607757.096112:0:22567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefa9 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607757.096205:0:22567:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d77c610b000 10000000:01000000:2.0:1789607757.096211:0:22567:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789607757.096217:0:22567:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d78c5b919c0 10000000:01000000:2.0:1789607757.096220:0:22567:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789607757.096223:0:22567:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d78c5b919c0 from 1 10000000:01000000:2.0:1789607757.096271:0:22567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789607757.096306:0:22567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ce00/0xa26202d240fbf0b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607757.096326:0:22567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ce00/0xa26202d240fbf0b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607757.096338:0:22567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ce00/0xa26202d240fbf0b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607757.096361:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607757.096684:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607757.096775:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd5d2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789607757.099400:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150145408 00000100:00100000:1.0:1789607757.099478:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150145408 00000100:00100000:3.0:1789607757.103504:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789607757.103528:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+12:22567:x1876539150145408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607757.103548:0:21923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607757.103586:0:21923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7900ef9e00/0xa26202d240fbf0ba lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf0b3 expref: -99 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.103614:0:21923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef9e00/0xa26202d240fbf0ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf0b3 expref: 13 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.103625:0:21923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7900ef9e00/0xa26202d240fbf0ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf0b3 expref: 13 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.103633:0:21923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9e00, rc 0) 00000100:00100000:3.0:1789607757.103790:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+13:22567:x1876539150145408:12345-0@lo:101:mount.lustre.0 Request processed in 274us (7108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607757.103799:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607757.109148:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607757.109183:0:22567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ce00/0xa26202d240fbf0b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf0ba expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.109196:0:22567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ce00/0xa26202d240fbf0b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf0ba expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607757.109405:0:22567:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789607757.109574:0:22567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ce00/0xa26202d240fbf0b3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf0ba expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.109583:0:22567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd59ce00/0xa26202d240fbf0b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf0ba expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607757.109595:0:22567:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d77c610b000 10000000:01000000:0.0:1789607757.109672:0:22567:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789607757.109679:0:22567:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d77c610b000 from 1 10000000:01000000:0.0:1789607757.109682:0:22567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789607757.109722:0:22567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64400/0xa26202d240fbf0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.109731:0:22567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64400/0xa26202d240fbf0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.109740:0:22567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64400/0xa26202d240fbf0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607757.109769:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789607757.109840:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607757.109902:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370600 going to sleep for 11 seconds 00000100:00100000:1.0:1789607757.110031:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150145536 00000100:00100000:1.0:1789607757.110038:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150145536 00000100:00100000:1.0:1789607757.110093:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607757.110102:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+13:22567:x1876539150145536:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607757.110115:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607757.110128:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fcf76000/0xa26202d240fbf0c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf0c1 expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.110160:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fcf76000/0xa26202d240fbf0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf0c1 expref: 14 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.110170:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fcf76000/0xa26202d240fbf0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf0c1 expref: 14 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.110178:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf76000, rc 0) 00000100:00100000:1.0:1789607757.110215:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+14:22567:x1876539150145536:12345-0@lo:101:mount.lustre.0 Request processed in 114us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607757.110222:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789607757.110363:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607757.110376:0:22567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64400/0xa26202d240fbf0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf0c8 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.110384:0:22567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64400/0xa26202d240fbf0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf0c8 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607757.110397:0:22567:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789607757.114756:0:22567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64400/0xa26202d240fbf0c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf0c8 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.114777:0:22567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64400/0xa26202d240fbf0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf0c8 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607757.114787:0:22567:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789607757.114798:0:22567:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789607757.114805:0:22567:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d77c610b000 10000000:01000000:0.0:1789607757.114808:0:22567:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789607757.114812:0:22567:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789607757.114815:0:22567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789607757.114853:0:22567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65c00/0xa26202d240fbf0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.114876:0:22567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65c00/0xa26202d240fbf0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.114904:0:22567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65c00/0xa26202d240fbf0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607757.114941:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789607757.115023:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607757.115069:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370600 going to sleep for 11 seconds 00000100:00100000:1.0:1789607757.116183:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150145664 00000100:00100000:1.0:1789607757.116206:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150145664 00000100:00100000:1.0:1789607757.116266:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789607757.116276:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+14:22567:x1876539150145664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607757.116291:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607757.116307:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fcf77e00/0xa26202d240fbf0d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf0cf expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.116334:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fcf77e00/0xa26202d240fbf0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf0cf expref: 15 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.116344:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fcf77e00/0xa26202d240fbf0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf0cf expref: 15 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.116352:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77e00, rc 0) 00000100:00100000:1.0:1789607757.116425:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+15:22567:x1876539150145664:12345-0@lo:101:mount.lustre.0 Request processed in 151us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607757.116432:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607757.116771:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607757.116789:0:22567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65c00/0xa26202d240fbf0cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf0d6 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.116799:0:22567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65c00/0xa26202d240fbf0cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf0d6 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607757.119408:0:22567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1789607757.122354:0:22567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607757.122725:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789607757.122770:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1789607757.122814:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1789607757.122847:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1789607757.136026:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1789607757.136124:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1789607757.136177:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1789607757.136209:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1789607757.136268:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1789607757.136303:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1789607757.136335:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1789607757.136379:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1789607757.136414:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1789607757.136447:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1789607757.136491:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1789607757.136524:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1789607757.136584:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1789607757.136633:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1789607757.136666:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1789607757.136698:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1789607757.136746:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1789607757.136781:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1789607757.136811:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1789607757.136853:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1789607757.136914:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1789607757.136944:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1789607757.137002:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1789607757.137035:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1789607757.137079:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1789607757.137125:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1789607757.137160:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1789607757.137192:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1789607757.137255:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1789607757.137291:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1789607757.137322:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1789607757.137367:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1789607757.137401:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1789607757.137432:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1789607757.137477:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1789607757.137512:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1789607757.137544:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1789607757.137587:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1789607757.137640:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1789607757.137672:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1789607757.137785:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1789607757.137793:0:22567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1789607757.137934:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607757.138011:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607757.138058:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607757.138582:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150145792 00000100:00100000:2.0:1789607757.138592:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150145792 00000100:00100000:2.0:1789607757.138635:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789607757.138644:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+15:22567:x1876539150145792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607757.139069:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+15:22567:x1876539150145792:12345-0@lo:501:mount.lustre.0 Request processed in 425us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607757.139076:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789607757.146414:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607757.146520:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607757.146594:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607757.146626:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607757.150137:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150145920 00000100:00100000:2.0:1789607757.150153:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150145920 00000100:00100000:2.0:1789607757.150232:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789607757.150242:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+15:22567:x1876539150145920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607757.150699:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+15:22567:x1876539150145920:12345-0@lo:503:mount.lustre.0 Request processed in 457us (4104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607757.150707:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789607757.150984:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150145920:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789607757.151654:0:22567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789607757.151731:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150146048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607757.151791:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.151834:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607757.152057:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150146048 00000100:00100000:2.0:1789607757.152063:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150146048 00000100:00100000:2.0:1789607757.152109:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789607757.152126:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+15:22567:x1876539150146048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607757.154799:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+15:22567:x1876539150146048:12345-0@lo:502:mount.lustre.0 Request processed in 2665us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607757.154814:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789607757.155030:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150146048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789607757.155324:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1789607757.155402:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1789607757.155455:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1789607757.155492:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1789607757.155526:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1789607757.155583:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1789607757.155617:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1789607757.155648:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1789607757.155693:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1789607757.155729:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1789607757.155761:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1789607757.155807:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1789607757.155845:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1789607757.155928:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1789607757.155991:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1789607757.156029:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1789607757.156063:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1789607757.156125:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1789607757.156162:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1789607757.156195:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1789607757.156243:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1789607757.156279:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1789607757.156313:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1789607757.156363:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1789607757.156401:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1789607757.156434:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1789607757.156481:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1789607757.156518:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1789607757.156550:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1789607757.156594:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1789607757.156626:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1789607757.156656:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1789607757.156699:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1789607757.156756:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1789607757.156790:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1789607757.156837:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1789607757.156908:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1789607757.156945:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1789607757.166006:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1789607757.166046:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1789607757.166078:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1789607757.166122:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1789607757.166324:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1789607757.166359:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1789607757.166411:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150146176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607757.166616:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.166661:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607757.167040:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150146176 00000100:00100000:2.0:1789607757.167049:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150146176 00000100:00100000:2.0:1789607757.167104:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789607757.167115:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+15:22567:x1876539150146176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607757.167408:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+15:22567:x1876539150146176:12345-0@lo:502:mount.lustre.0 Request processed in 294us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607757.167416:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607757.167679:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150146176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607757.167810:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1789607757.167823:0:22567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1789607757.169727:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607757.169742:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607757.169744:0:22569:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789607757.169751:0:22569:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789607757.169754:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607757.169769:0:22569:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8d78f9d2b380) 00000020:00000080:3.0:1789607757.169789:0:22569:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789607757.169794:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789607757.169923:0:22569:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789607757.170002:0:22569:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbf0e4 00000020:00000080:3.0:1789607757.170388:0:22569:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789607757.170393:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607757.170397:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607757.170398:0:22569:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789607757.170401:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607757.170404:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607757.170406:0:22569:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789607757.170409:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607757.170417:0:22569:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8d78f9d2cd40) 00000020:00000080:3.0:1789607757.170606:0:22569:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789607757.170612:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789607757.170614:0:22569:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789607757.170617:0:22569:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789607757.170623:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789607757.170673:0:22569:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d77c610b000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789607757.170686:0:22569:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8d78f9d28000) 00000020:00000080:3.0:1789607757.170694:0:22569:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789607757.170752:0:22569:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789607757.170758:0:22569:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbf0f9 00000020:00000080:3.0:1789607757.170854:0:22569:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789607757.170899:0:22569:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789607757.170906:0:22569:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa26202d240fbf100 00080000:01000000:3.0:1789607757.170912:0:22569:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789607757.170922:0:22569:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbf107 00000100:00100000:2.0:1789607757.284286:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00010000:00010000:1.0:1789607757.285041:0:22569:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1789607757.285742:0:22569:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1789607757.290071:0:22569:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789607757.292666:0:22569:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789607757.292679:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607757.292685:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607757.292688:0:22569:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789607757.292693:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607757.292699:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607757.292700:0:22569:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789607757.292703:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789607757.292708:0:22569:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:00000080:2.0:1789607757.292734:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607757.292749:0:22569:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8d78ef164d40) 00000020:00000080:2.0:1789607757.292772:0:22569:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789607757.292777:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789607757.292837:0:22569:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789607757.292844:0:22569:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789607757.292851:0:22569:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbf115 00010000:00080000:2.0:1789607757.292927:0:22569:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78fc941800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1789607757.297528:0:22569:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1789607757.304600:0:22569:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789607757.304616:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789607757.304654:0:22569:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789607757.304678:0:22569:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbf11c 00000100:00080000:3.0:1789607757.304688:0:22569:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789607757.304699:0:22569:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d78fc941800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607757.304733:0:22569:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d790133c380 x1876539150146304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607757.304752:0:22569:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1789607757.304802:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607757.304806:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607757.304808:0:22569:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789607757.304811:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789607757.304814:0:22569:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789607757.304816:0:22569:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789607757.304818:0:22569:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789607757.304819:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789607757.304822:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607757.304823:0:22569:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789607757.304826:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607757.304831:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607757.304832:0:22569:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789607757.304836:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789607757.304888:0:22569:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789607757.304902:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607757.304906:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607757.304907:0:22569:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789607757.304910:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789607757.304912:0:22569:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1789607757.304913:0:22569:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789607757.304914:0:22569:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789607757.304923:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789607757.304925:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607757.304927:0:22569:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789607757.304929:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789607757.304933:0:22569:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt2/mdt2 00000020:00000080:3.0:1789607757.304936:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607757.304937:0:22569:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789607757.304940:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789607757.304944:0:22569:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:3.0:1789607757.304974:0:22569:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789607757.304978:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607757.304992:0:22569:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d77c4ce4d40) 00000020:00000080:3.0:1789607757.305005:0:22569:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789607757.305009:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789607757.305080:0:22569:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789607757.305087:0:22569:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789607757.305093:0:22569:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbf12a 00000100:00080000:2.0:1789607757.305308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789607757.305313:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1789607757.305434:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150146304:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789607757.305502:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607757.306467:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150146304 00000100:00100000:0.0:1789607757.306481:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150146304 00000100:00100000:0.0:1789607757.306530:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607757.306538:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3467:x1876539150146304:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789607757.306587:0:21935:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:0.0:1789607757.306623:0:21935:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbf131 00000004:00100000:0.0:1789607757.306636:0:21935:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789607757.306642:0:21935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:2.0:1789607757.307207:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d78c7d23800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789607757.307215:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 658 00000100:00080000:2.0:1789607757.307219:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789607757.307228:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d78c7d23800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607757.307256:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78c61fc700 x1876539150146432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789607757.307275:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607757.307278:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607757.307281:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607757.307284:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1789607757.308684:0:22569:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78ef1f0800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.125@tcp at head 00010000:00010000:3.0:1789607757.308961:0:22569:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1789607757.309222:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607757.309244:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150146560:0@lo:400:kworker.0 00000100:00100000:0.0:1789607757.309311:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.309454:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150146432:0@lo:38:kworker.0 00000100:00100000:1.0:1789607757.309491:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607757.312152:0:21936:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789607757.312167:0:21936:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:01000000:3.0:1789607757.313015:0:22569:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789607757.313063:0:22569:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789607757.313948:0:22569:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607757.314035:0:22569:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:2.0:1789607757.314038:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150146560 00000100:00100000:2.0:1789607757.314048:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150146560 00000040:00080000:3.0:1789607757.314102:0:22569:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1789607757.314106:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607757.314115:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150146560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607757.314215:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150146560:12345-0@lo:400:kworker.0 Request processed in 101us (4903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607757.314222:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789607757.314230:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d78c61fca80 x1876539150146560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607757.314245:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150146560:0@lo:400:kworker.0 00000100:00100000:1.0:1789607757.318238:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150146432 00000100:00100000:1.0:1789607757.318250:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150146432 00000100:00100000:1.0:1789607757.318352:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607757.318361:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3467:x1876539150146432:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789607757.318457:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3467:x1876539150146432:12345-0@lo:38:kworker.0 Request processed in 95us (8964us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789607757.318464:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607757.318502:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789607757.318510:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c7d23800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607757.318514:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789607757.318518:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150146432:0@lo:38:kworker.0 00000040:00080000:3.0:1789607757.321724:0:22575:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789607757.321732:0:22575:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789607757.331022:0:22569:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789607757.331039:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789607757.331082:0:22569:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789607757.331624:0:22569:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbf138 00000100:00080000:1.0:1789607757.331636:0:22569:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789607757.331648:0:22569:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d78ef1f0800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607757.331684:0:22569:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cf7c4700 x1876539150146688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607757.331719:0:22569:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789607757.331772:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607757.331776:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607757.331778:0:22569:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789607757.331781:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789607757.331783:0:22569:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1789607757.331785:0:22569:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789607757.331786:0:22569:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789607757.331788:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789607757.331790:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607757.331791:0:22569:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789607757.331794:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789607757.331798:0:22569:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt2/mdt2 00000020:00000080:1.0:1789607757.331801:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607757.331803:0:22569:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789607757.331806:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789607757.331809:0:22569:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.125@tcp to nid 0x20000c0a8cb7d (192.168.203.125@tcp) 00000020:01000000:1.0:1789607757.331831:0:22569:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789607757.331833:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789607757.331845:0:22569:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d78f05b0000) 00000020:00000080:1.0:1789607757.331884:0:22569:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789607757.331891:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:2.0:1789607757.332027:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607757.332032:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607757.332035:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607757.332044:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789607757.332479:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150146688:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789607757.332534:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150146688 offset 0 length 520: 4 00000004:00080000:1.0:1789607757.332702:0:22569:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789607757.332710:0:22569:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789607757.332716:0:22569:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa26202d240fbf146 00010000:00080000:1.0:1789607757.332758:0:22569:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78f06c2800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.125@tcp at head 00010000:00010000:1.0:1789607757.333026:0:22569:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789607757.333223:0:22569:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789607757.333246:0:22569:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789607757.333647:0:22569:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607757.333728:0:22569:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1789607757.333817:0:22569:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1789607757.338394:0:22578:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789607757.338402:0:22578:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789607757.339813:0:22569:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789607757.339828:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789607757.340033:0:22569:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789607757.340060:0:22569:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbf14d 00000100:00080000:1.0:1789607757.340071:0:22569:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789607757.340082:0:22569:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d78f06c2800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607757.340260:0:22569:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cf7c6d80 x1876539150146816/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607757.340327:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150146816:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789607757.340379:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150146816 offset 0 length 520: 4 00000100:00080000:1.0:1789607757.340434:0:22569:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789607757.340508:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607757.340512:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607757.340514:0:22569:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789607757.340517:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607757.340521:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607757.340523:0:22569:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789607757.340525:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789607757.340527:0:22569:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789607757.340529:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607757.340532:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607757.340546:0:22569:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789607757.340550:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607757.340553:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607757.340554:0:22569:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789607757.340558:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789607757.340640:0:22569:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607757.340645:0:22569:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607757.340646:0:22569:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789607757.340650:0:22569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:1.0:1789607757.340780:0:22567:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1789607757.340803:0:22567:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789607757.340817:0:22567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65c00/0xa26202d240fbf0cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf0d6 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.340829:0:22567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65c00/0xa26202d240fbf0cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf0d6 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607757.340836:0:22567:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d77c610b000 from 1 10000000:01000000:1.0:1789607757.340839:0:22567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789607757.340883:0:22567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.340891:0:22567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.340902:0:22567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607757.340918:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150146944:0@lo:101:mount.lustre.0 00000100:00080000:2.0:1789607757.341023:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607757.341028:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607757.341031:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607757.341034:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789607757.341283:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.341317:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c52899c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607757.342167:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150146944 00000100:00100000:2.0:1789607757.342175:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150146944 00000100:00100000:2.0:1789607757.342222:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789607757.342231:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+15:22567:x1876539150146944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607757.342245:0:21923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607757.342259:0:21923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf15b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf154 expref: -99 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607757.342285:0:21923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf154 expref: 16 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607757.342295:0:21923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf154 expref: 16 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607757.342304:0:21923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59c000, rc 0) 00000100:00100000:2.0:1789607757.342351:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+16:22567:x1876539150146944:12345-0@lo:101:mount.lustre.0 Request processed in 121us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607757.342357:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789607757.342642:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150146944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607757.342660:0:22567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf15b expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.342669:0:22567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf15b expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607757.343795:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147072:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789607757.343856:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.343914:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c52899c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607757.346070:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150147072 00000100:00100000:2.0:1789607757.346085:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150147072 00000100:00100000:2.0:1789607757.346161:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789607757.346171:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+16:22567:x1876539150147072:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789607757.346256:0:21925:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789607757.346274:0:21925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789607757.346277:0:21925:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1789607757.346409:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+16:22567:x1876539150147072:12345-0@lo:256:mount.lustre.0 Request processed in 238us (2551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607757.346416:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607757.349083:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147072:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789607757.352508:0:22567:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789607757.352533:0:22567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf15b expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.352546:0:22567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf15b expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607757.352555:0:22567:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d77c610b000 from 1 10000000:01000000:1.0:1789607757.352557:0:22567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789607757.352595:0:22567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.352603:0:22567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.352614:0:22567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607757.352653:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789607757.354790:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.354910:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c52899c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607757.354984:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150147200 00000100:00100000:3.0:1789607757.354994:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150147200 00000100:00100000:3.0:1789607757.355046:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789607757.355056:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+16:22567:x1876539150147200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607757.355071:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607757.355110:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf169 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf162 expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.355149:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf162 expref: 17 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.355160:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf162 expref: 17 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.355170:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8c00, rc 0) 00000100:00100000:3.0:1789607757.355228:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+17:22567:x1876539150147200:12345-0@lo:101:mount.lustre.0 Request processed in 174us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607757.355234:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789607757.355387:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607757.355403:0:22567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf169 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607757.355412:0:22567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf169 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789607757.356009:0:22567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1789607757.356677:0:22567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607757.360553:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789607757.360643:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1789607757.360697:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1789607757.360747:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1789607757.360784:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1789607757.360833:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1789607757.360939:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1789607757.360988:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1789607757.361053:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789607757.361533:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1789607757.361578:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1789607757.361692:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1789607757.361703:0:22567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1789607757.361830:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607757.362904:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.363249:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150147328 00000100:00100000:1.0:1789607757.363265:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150147328 00000100:00100000:1.0:1789607757.363314:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607757.363324:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+17:22567:x1876539150147328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607757.363538:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+17:22567:x1876539150147328:12345-0@lo:501:mount.lustre.0 Request processed in 215us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607757.363546:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607757.363597:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c52899c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607757.365731:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607757.365794:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607757.365881:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.365914:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c52899c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607757.366075:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150147456 00000100:00100000:2.0:1789607757.366082:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150147456 00000100:00100000:1.0:1789607757.366303:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789607757.366314:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+17:22567:x1876539150147456:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607757.366495:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+17:22567:x1876539150147456:12345-0@lo:503:mount.lustre.0 Request processed in 183us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607757.366502:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789607757.366605:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147456:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789607757.368240:0:22567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789607757.368318:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607757.368386:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.368433:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150147584 00000100:00100000:1.0:1789607757.368440:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150147584 00000100:00100000:1.0:1789607757.368478:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607757.368485:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+17:22567:x1876539150147584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607757.368670:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+17:22567:x1876539150147584:12345-0@lo:502:mount.lustre.0 Request processed in 185us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607757.368684:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607757.369091:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56480 going to sleep for 11 seconds 00000100:00100000:1.0:1789607757.369347:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789607757.369604:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789607757.369656:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1789607757.369706:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1789607757.369759:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1789607757.369796:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1789607757.369843:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1789607757.369910:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1789607757.369972:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1789607757.370023:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789607757.370059:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1789607757.370193:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1789607757.370234:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607757.370294:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.370323:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607757.370397:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150147712 00000100:00100000:2.0:1789607757.370404:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150147712 00000100:00100000:2.0:1789607757.370447:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789607757.370455:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+17:22567:x1876539150147712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607757.370637:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+17:22567:x1876539150147712:12345-0@lo:502:mount.lustre.0 Request processed in 182us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607757.370644:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789607757.370741:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789607757.370819:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1789607757.370827:0:22567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789607757.373169:0:22580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607757.373180:0:22580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607757.373183:0:22580:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789607757.373191:0:22580:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d77c610b000 00000020:00000080:2.0:1789607757.373193:0:22580:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607757.373200:0:22580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607757.373202:0:22580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607757.373203:0:22580:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789607757.373205:0:22580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607757.373208:0:22580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607757.373210:0:22580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789607757.373213:0:22580:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d77c610b000 00000020:00000080:2.0:1789607757.373215:0:22580:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607757.373268:0:22580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607757.373271:0:22580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607757.373282:0:22580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789607757.373286:0:22580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607757.373289:0:22580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607757.373290:0:22580:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789607757.373293:0:22580:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d77c610b000 00000020:00000080:2.0:1789607757.373295:0:22580:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607757.373311:0:22580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607757.373313:0:22580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607757.373315:0:22580:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789607757.373317:0:22580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607757.373319:0:22580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607757.373320:0:22580:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789607757.373323:0:22580:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d77c610b000 00000020:00000080:2.0:1789607757.373325:0:22580:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607757.373357:0:22580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607757.373360:0:22580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607757.373362:0:22580:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789607757.373364:0:22580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1789607757.380590:0:22567:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789607757.380631:0:22567:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789607757.380650:0:22567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf169 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.380662:0:22567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf169 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607757.380714:0:22567:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789607757.380718:0:22567:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d77c610b000 10000000:01000000:0.0:1789607757.380721:0:22567:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d77c610b000 10000000:01000000:0.0:1789607757.380736:0:22567:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789607757.380743:0:22567:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d77c610b000 from 1 10000000:01000000:0.0:1789607757.380746:0:22567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789607757.380783:0:22567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64e00/0xa26202d240fbf170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.380792:0:22567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64e00/0xa26202d240fbf170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.380803:0:22567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64e00/0xa26202d240fbf170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607757.380827:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147840:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789607757.380971:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607757.381007:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150147840 00000100:00100000:0.0:1789607757.381013:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150147840 00000100:00100000:0.0:1789607757.381053:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789607757.381062:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+17:22567:x1876539150147840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607757.381075:0:21925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607757.381088:0:21925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c3f64600/0xa26202d240fbf177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf170 expref: -99 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.381643:0:21925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c3f64600/0xa26202d240fbf177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf170 expref: 18 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.381655:0:21925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c3f64600/0xa26202d240fbf177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf170 expref: 18 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.381664:0:21925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c3f64600, rc 0) 00000100:00100000:0.0:1789607757.381704:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+18:22567:x1876539150147840:12345-0@lo:101:mount.lustre.0 Request processed in 642us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607757.381718:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789607757.381767:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d79013700c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607757.381788:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607757.381803:0:22567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64e00/0xa26202d240fbf170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf177 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.381812:0:22567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64e00/0xa26202d240fbf170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf177 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607757.382923:0:22567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1789607757.390966:0:22567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607757.392513:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1789607757.392575:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1789607757.392608:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1789607757.392658:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1789607757.392697:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1789607757.396855:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1789607757.398229:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1789607757.398279:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1789607757.398338:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1789607757.398369:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1789607757.398397:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1789607757.398442:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1789607757.398474:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1789607757.398504:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1789607757.398545:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1789607757.398576:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1789607757.398605:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1789607757.398647:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1789607757.398680:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1789607757.398727:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1789607757.398768:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1789607757.398823:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1789607757.398855:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1789607757.401052:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000100:00080000:0.0:1789607757.403425:0:21935:0:(import.c:65:import_set_state_nolock()) ffff8d78fcb59800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607757.403519:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3467:x1876539150146304:12345-0@lo:38:llog_process_th.0 Request processed in 96979us (98015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607757.403529:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607757.403590:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789607757.403599:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789607757.403607:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789607757.403613:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789607757.403615:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fc941800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789607757.403625:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150146304:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789607757.403712:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1789607757.403757:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1789607757.403814:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1789607757.403848:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1789607757.403898:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1789607757.403946:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1789607757.403994:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1789607757.404021:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1789607757.404049:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1789607757.404092:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1789607757.404139:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1789607757.404185:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1789607757.404217:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1789607757.404270:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1789607757.404315:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1789607757.404365:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1789607757.404400:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1789607757.404435:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1789607757.404478:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1789607757.404513:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1789607757.404541:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1789607757.404580:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1789607757.404612:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1789607757.404645:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1789607757.404739:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1789607757.404776:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1789607757.404830:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1789607757.404838:0:22567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1789607757.406240:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150148096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607757.406310:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.408362:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150148096 00000100:00100000:1.0:1789607757.408374:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150148096 00000100:00100000:1.0:1789607757.408422:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607757.408430:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539150148096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607757.408472:0:21936:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607757.408555:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539150148096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607757.408562:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607757.420195:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150148096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607757.420303:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607757.420376:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607757.420420:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d79013700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607757.420463:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150147968 00000100:00100000:2.0:1789607757.420469:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150147968 00000100:00100000:2.0:1789607757.420512:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789607757.420520:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+18:22567:x1876539150147968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607757.420783:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+18:22567:x1876539150147968:12345-0@lo:501:mount.lustre.0 Request processed in 262us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607757.420790:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789607757.420994:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150147968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607757.421032:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150148224:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607757.421066:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607757.421084:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d79013700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607757.421138:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150148224 00000100:00100000:2.0:1789607757.421143:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150148224 00000100:00100000:2.0:1789607757.421167:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789607757.421174:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790102ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+18:22567:x1876539150148224:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607757.421325:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790102ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+18:22567:x1876539150148224:12345-0@lo:503:mount.lustre.0 Request processed in 151us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607757.421332:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789607757.421400:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150148224:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789607757.421983:0:22567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607757.422043:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150148352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607757.422084:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607757.422114:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150148352 00000100:00100000:0.0:1789607757.422119:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150148352 00000100:00100000:0.0:1789607757.422148:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789607757.422156:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+18:22567:x1876539150148352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607757.422336:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+18:22567:x1876539150148352:12345-0@lo:502:mount.lustre.0 Request processed in 180us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607757.422343:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789607757.422376:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d79013700c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607757.422389:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150148352:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607757.422591:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1789607757.422636:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1789607757.422670:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1789607757.422718:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1789607757.422755:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1789607757.422804:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1789607757.422842:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1789607757.422903:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1789607757.422966:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1789607757.423005:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1789607757.423039:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1789607757.423085:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1789607757.423122:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1789607757.423174:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1789607757.423223:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1789607757.423256:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1789607757.423283:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1789607757.423324:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1789607757.423356:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1789607757.423384:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1789607757.423422:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1789607757.423455:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1789607757.423487:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1789607757.423547:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1789607757.423589:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1789607757.423634:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1789607757.423681:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1789607757.423717:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1789607757.423750:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1789607757.423816:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1789607757.423852:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1789607757.423916:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1789607757.423961:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1789607757.424016:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1789607757.424052:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1789607757.424098:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1789607757.424136:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1789607757.424168:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1789607757.424218:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1789607757.424252:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1789607757.424279:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1789607757.424310:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1789607757.424355:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1789607757.424389:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1789607757.424420:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1789607757.424487:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1789607757.424525:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1789607757.424558:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1789607757.424626:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150148480:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607757.424694:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607757.424759:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150148480 00000100:00100000:0.0:1789607757.424766:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150148480 00000100:00100000:0.0:1789607757.424808:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789607757.424817:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d9471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+18:22567:x1876539150148480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607757.425931:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d79013700c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607757.430427:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d9471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+18:22567:x1876539150148480:12345-0@lo:502:mount.lustre.0 Request processed in 5602us (5724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607757.430448:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789607757.430546:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150148480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607757.430687:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1789607757.430834:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1789607757.430911:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150148608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607757.430964:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607757.430994:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150148608 00000100:00100000:3.0:1789607757.431000:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150148608 00000100:00100000:3.0:1789607757.431032:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607757.431038:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d9472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+18:22567:x1876539150148608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607757.431172:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d9472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+18:22567:x1876539150148608:12345-0@lo:502:mount.lustre.0 Request processed in 133us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607757.431179:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607757.431216:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0868c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607757.431227:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150148608:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607757.431302:0:22567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1789607757.431311:0:22567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789607757.436584:0:22585:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789607757.436604:0:22585:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8d78e9eecd40) 00000020:00000080:0.0:1789607757.436629:0:22585:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789607757.436704:0:22585:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d77c610b000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789607757.436709:0:22585:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d77c610b000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789607757.436711:0:22585:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d77c610b000 3 00010000:00080000:0.0:1789607757.436776:0:22585:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78c75d7000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.125@tcp at head 00010000:00010000:0.0:1789607757.438469:0:22585:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789607757.438693:0:22585:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789607757.438731:0:22585:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789607757.438744:0:22585:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa26202d240fbf185 00000100:00080000:0.0:1789607757.438754:0:22585:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607757.438764:0:22585:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d78c75d7000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607757.438804:0:22585:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78ff79c380 x1876539150148736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607757.438851:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3467:1876539150148736:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789607757.438961:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607757.439027:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150148736 00000100:00100000:0.0:1789607757.439034:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150148736 00000100:00100000:0.0:1789607757.439072:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607757.439078:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3467:x1876539150148736:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789607757.439100:0:21932:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:0.0:1789607757.439134:0:21932:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa26202d240fbf18c 00000004:00100000:0.0:1789607757.439146:0:21932:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789607757.439174:0:21932:0:(import.c:65:import_set_state_nolock()) ffff8d78c2f76800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607757.439227:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3467:x1876539150148736:12345-0@lo:38:llog_process_th.0 Request processed in 148us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607757.439234:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789607757.439266:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d78ff79c380 x1876539150148736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607757.439276:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789607757.439284:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789607757.439290:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789607757.439294:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789607757.439296:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c75d7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789607757.439301:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3467:1876539150148736:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789607757.439319:0:22585:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789607757.439340:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607757.439344:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607757.439346:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607757.439349:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789607757.445920:0:22585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1789607757.449478:0:22567:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789607757.449520:0:22567:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789607757.449541:0:22567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64e00/0xa26202d240fbf170 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf177 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.449554:0:22567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64e00/0xa26202d240fbf170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf177 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789607757.449608:0:22567:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789607757.449610:0:22567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789607757.449612:0:22567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607757.449613:0:22567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607757.449614:0:22567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607757.449616:0:22567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607757.449617:0:22567:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607757.449619:0:22567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607757.449620:0:22567:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607757.449623:0:22567:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1789607757.449626:0:22567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607757.449627:0:22567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789607757.449628:0:22567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607757.449629:0:22567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607757.449630:0:22567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607757.449632:0:22567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607757.449633:0:22567:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607757.449634:0:22567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607757.449635:0:22567:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607757.449664:0:22567:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789607757.449687:0:22567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150148864:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789607757.449758:0:22567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607757.449795:0:22567:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0868b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607757.452166:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150148864 00000100:00100000:0.0:1789607757.452180:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150148864 00000100:00100000:0.0:1789607757.452239:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789607757.452249:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+18:22567:x1876539150148864:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789607757.452284:0:21925:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789607757.452300:0:21925:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789607757.497177:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789607757.497264:0:21925:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789607757.497275:0:21925:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789607757.497307:0:21946:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789607757.497312:0:21946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789607757.497333:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.497352:0:21946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fcf76200/0xa26202d240fbf097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf090 expref: 18 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.497360:0:21946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf15b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf154 expref: 18 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.497367:0:21946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.497407:0:21946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbf154 expref: 18 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.497422:0:21946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf15b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbf154 expref: 18 pid: 21923 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607757.497436:0:21946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150148992:0@lo:104: 00000100:00100000:0.0:1789607757.497501:0:21946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607757.497548:0:21946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fcf76200/0xa26202d240fbf097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbf090 expref: 18 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.497557:0:21946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fcf76200/0xa26202d240fbf097 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbf090 expref: 18 pid: 21924 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607757.497564:0:21946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150149120:0@lo:104: 00000100:00100000:0.0:1789607757.497584:0:21946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607757.497602:0:21946:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fc8b7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789607757.497641:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150148992 00000100:00100000:0.0:1789607757.497649:0:21914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150148992 00000100:00100000:0.0:1789607757.497682:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150149120 00000100:00100000:0.0:1789607757.497684:0:21914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150149120 00000100:00100000:0.0:1789607757.497698:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607757.497705:0:21914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+4:21946:x1876539150148992:12345-0@lo:104: 00010000:00010000:0.0:1789607757.498014:0:21914:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf15b expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.498101:0:21914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789607757.498108:0:21914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+4:21946:x1876539150148992:12345-0@lo:104: Request processed in 403us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607757.498123:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607757.498142:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607757.498150:0:21914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:21946:x1876539150149120:12345-0@lo:104: 00010000:00010000:0.0:1789607757.498159:0:21914:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf097 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.498348:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607757.498361:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf15b expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.498368:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607757.498373:0:21919:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbf15b expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.498381:0:21919:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbf15b expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607757.498387:0:21919:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbf15b expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607757.498393:0:21919:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607757.498423:0:21919:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf15b expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.498429:0:21919:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607757.498456:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf15b expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.498463:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf15b expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.498474:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607757.498477:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf097 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.498483:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f65e00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607757.498486:0:21919:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbf097 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.498503:0:21919:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbf097 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607757.498510:0:21919:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbf097 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607757.498515:0:21919:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607757.498528:0:21919:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf097 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.498534:0:21919:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607757.498540:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf097 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.498546:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65e00/0xa26202d240fbf090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf097 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.498558:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607757.498559:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607757.498562:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607757.498615:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150149248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607757.498654:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607757.498695:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607757.498703:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150149376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607757.498738:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607757.498914:0:21916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150149248 00000100:00100000:3.0:1789607757.498920:0:21916:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150149248 00010000:00010000:3.0:1789607757.499101:0:21916:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf15b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf154 expref: 19 pid: 21923 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607757.499243:0:21916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150149376 00000100:00100000:3.0:1789607757.499247:0:21916:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150149376 00010000:00010000:3.0:1789607757.499261:0:21916:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fcf76200/0xa26202d240fbf097 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf090 expref: 20 pid: 21924 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607757.499274:0:21916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607757.499287:0:21916:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77c69b89-f077-4f20-ab40-68d85082562e+20:3470:x1876539150149248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607757.499299:0:21916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607757.499304:0:21916:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf15b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf154 expref: 20 pid: 21923 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.499315:0:21916:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf15b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbf154 expref: 20 pid: 21923 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.499329:0:21916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607757.499364:0:21916:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77c69b89-f077-4f20-ab40-68d85082562e+20:3470:x1876539150149248:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607757.499370:0:21916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607757.499385:0:21916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607757.499391:0:21916:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77c69b89-f077-4f20-ab40-68d85082562e+19:3470:x1876539150149376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607757.499398:0:21916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607757.499402:0:21916:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fcf76200/0xa26202d240fbf097 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf090 expref: 19 pid: 21924 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.499410:0:21916:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fcf76200/0xa26202d240fbf097 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbf090 expref: 19 pid: 21924 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.499421:0:21916:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.499430:0:21916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789607757.499443:0:21916:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003957264s 00010000:00010000:3.0:1789607757.499448:0:21916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.499462:0:21916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.499469:0:21916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.499475:0:21916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.499481:0:21916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f64800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:3.0:1789607757.499485:0:21916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.499494:0:21916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.499502:0:21916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607757.499512:0:21916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607757.499534:0:21916:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77c69b89-f077-4f20-ab40-68d85082562e+19:3470:x1876539150149376:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607757.499540:0:21916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607757.499628:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150149376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607757.499637:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150149248:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607757.500215:0:21914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789607757.500226:0:21914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:21946:x1876539150149120:12345-0@lo:104: Request processed in 2076us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607757.500235:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789607757.501222:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf15b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbf154 expref: 18 pid: 21923 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607757.501239:0:21946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150148992:0@lo:104: 00010000:00010000:0.0:1789607757.501254:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fcf76200/0xa26202d240fbf097 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbf090 expref: 17 pid: 21924 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607757.501281:0:21946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150149120:0@lo:104: 00010000:00010000:0.0:1789607757.501306:0:21946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.501316:0:21946:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.501322:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607757.501329:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf193 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607757.508983:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+16:22567:x1876539150148864:12345-0@lo:253:mount.lustre.0 Request processed in 56728us (59217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607757.508997:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1789607757.509327:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607757.512660:0:22567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:22567:1876539150148864:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789607757.512679:0:22567:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789607757.512683:0:22567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607757.512684:0:22567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789607757.512686:0:22567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607757.512687:0:22567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607757.512689:0:22567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607757.512690:0:22567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607757.512691:0:22567:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607757.512693:0:22567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607757.512695:0:22567:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789607757.512710:0:22567:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789607757.513595:0:22567:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607757.513770:0:22567:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607757.514343:0:22567:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607757.514515:0:22567:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607757.514803:0:22567:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607757.515238:0:22567:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607757.517610:0:22567:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607757.517803:0:22567:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607757.518204:0:22567:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607757.518370:0:22567:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607757.518648:0:22567:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x9:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607757.518807:0:22567:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:0.0:1789607757.522192:0:22567:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1789607757.522356:0:22593:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789607757.522361:0:22593:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789607757.522447:0:22594:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1789607757.522516:0:22594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789607757.523026:0:22567:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789607757.523461:0:22595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22595:1876539150149504:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789607757.523529:0:22595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607757.523555:0:22595:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd168180 going to sleep for 11 seconds 00000100:00100000:0.0:1789607757.523604:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150149504 00000100:00100000:0.0:1789607757.523611:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150149504 00000100:00100000:0.0:1789607757.523654:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607757.523664:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:22595:x1876539150149504:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789607757.523748:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:22595:x1876539150149504:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607757.523766:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607757.524045:0:22595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22595:1876539150149504:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1789607757.524072:0:22595:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789607757.524100:0:22595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22595:1876539150149632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789607757.525068:0:22595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607757.525102:0:22595:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd168180 going to sleep for 11 seconds 00000040:01000000:0.0:1789607757.525517:0:22567:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789607757.525652:0:22567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789607757.527298:0:22574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150149632 00000100:00100000:2.0:1789607757.527312:0:22574:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150149632 00000100:00100000:2.0:1789607757.527367:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607757.527375:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:22595:x1876539150149632:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789607757.527544:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:22595:x1876539150149632:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 169us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607757.527551:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607757.527587:0:22595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22595:1876539150149632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789607757.527683:0:22595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:22595:1876539150149760:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789607757.527720:0:22595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607757.527758:0:21941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150149760 00000100:00100000:2.0:1789607757.527762:0:21941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150149760 00000100:00100000:2.0:1789607757.527789:0:21941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607757.527796:0:21941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:22595:x1876539150149760:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789607757.527828:0:21941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:22595:x1876539150149760:12345-0@lo:900:lod0001_rec0000.0 Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607757.527834:0:21941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607757.527850:0:22595:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd168d80 going to sleep for 11 seconds 00010000:00080000:2.0:1789607757.527891:0:22595:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d78c61fe300 x1876539150149760/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789607773 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607757.527902:0:22595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:22595:1876539150149760:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789607757.527966:0:22595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22595:1876539150149888:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789607757.528002:0:22595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607757.528019:0:22595:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fd168180 going to sleep for 11 seconds 00000004:00000080:0.0:1789607757.528503:0:22567:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789607757.528515:0:22567:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1789607757.528757:0:22567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789607757.530339:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150149888 00000100:00100000:3.0:1789607757.530352:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150149888 00000100:00100000:3.0:1789607757.530412:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789607757.530421:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:22595:x1876539150149888:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789607757.530537:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:22595:x1876539150149888:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 117us (2533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607757.530556:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789607757.530666:0:22595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22595:1876539150149888:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789607757.530728:0:22595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607757.531732:0:22567:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789607757.532048:0:22594:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789607757.532094:0:22594:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1789607757.533711:0:22567:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789607757.533763:0:22567:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789607757.536784:0:22567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607757.537681:0:22595:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789607757.537747:0:22595:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789607757.537752:0:22595:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:1.0:1789607757.539850:0:22567:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x31:0x0] (8/8/4) registered 00000001:00000004:1.0:1789607757.544740:0:22567:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1789607757.606437:0:22567:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789607757.606471:0:22567:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa81b01d47988 00100000:10000000:1.0:1789607757.606478:0:22567:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789607757.608103:0:22567:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789607757.608162:0:22567:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789607757.608182:0:22567:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789607757.608207:0:22567:0:(super25.c:182:lustre_fill_super()) lustre-mdt2/mdt2: Mount complete 00010000:00010000:2.0:1789607757.733396:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607758.306120:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00000040:00080000:3.0:1789607758.502331:0:22590:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1789607758.630787:0:21927:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789607758.630795:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d77c610b000 from 12 10000000:01000000:3.0:1789607758.630801:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789607758.630854:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607758.630903:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607758.630914:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607758.630952:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150150016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607758.631019:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607758.631068:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607758.631113:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150150016 00000100:00100000:2.0:1789607758.631121:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150150016 00000100:00100000:2.0:1789607758.631178:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789607758.631188:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+16:21927:x1876539150150016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607758.631201:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607758.631216:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbf1a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf19a expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607758.631239:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbf1a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf19a expref: 17 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607758.631250:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbf1a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf19a expref: 17 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607758.631259:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59d800, rc 0) 00000100:00100000:2.0:1789607758.631297:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+17:21927:x1876539150150016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607758.631304:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789607758.631324:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150150016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607758.631343:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1a1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607758.631352:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf1a1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607758.631404:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150150144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789607758.631433:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607758.631458:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607758.632022:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150150144 00000100:00100000:2.0:1789607758.632035:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150150144 00000100:00100000:2.0:1789607758.632067:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789607758.632074:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+17:21927:x1876539150150144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789607758.632088:0:21925:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789607758.632102:0:21925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789607758.632105:0:21925:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789607758.632210:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+17:21927:x1876539150150144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607758.632219:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789607758.632237:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150150144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789607758.632290:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789607758.632297:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1a1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607758.632306:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1a1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607758.632314:0:21927:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789607758.632316:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78c2f72000 from 12 10000000:01000000:3.0:1789607758.632318:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789607758.632338:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607758.632346:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607758.632354:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607758.632369:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150150272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607758.632398:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607758.632432:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607758.632904:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150150272 00000100:00100000:2.0:1789607758.632910:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150150272 00000100:00100000:2.0:1789607758.632963:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789607758.632972:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+17:21927:x1876539150150272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607758.632982:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607758.632995:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf1af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf1a8 expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607758.633017:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf1af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf1a8 expref: 18 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607758.633026:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf1af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf1a8 expref: 18 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607758.633034:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59c000, rc 0) 00000100:00100000:2.0:1789607758.633073:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+18:21927:x1876539150150272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607758.633079:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789607758.633260:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150150272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607758.633276:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1af expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607758.633285:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf1af expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607758.633341:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150150400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789607758.633374:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607758.633680:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607758.633822:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150150400 00000100:00100000:2.0:1789607758.633827:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150150400 00000100:00100000:2.0:1789607758.633882:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789607758.633889:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+18:21927:x1876539150150400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789607758.633903:0:21925:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789607758.633915:0:21925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789607758.633986:0:21925:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789607758.634079:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+18:21927:x1876539150150400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 189us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607758.634087:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789607758.634091:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150150400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789607758.634140:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789607758.634148:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1af expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607758.634158:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1af expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607758.754163:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607759.330046:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00000040:00080000:0.0:1789607759.525199:0:22590:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789607759.786003:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607760.362048:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00010000:00010000:2.0:1789607760.802276:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607761.377978:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00000001:02000400:1.0:1789607761.812487:0:22840:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789607761.829998:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607762.408493:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 0 seconds 00000100:00080000:3.0:1789607762.662523:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789607762.662529:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789607762.662532:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78c7d23800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607762.662546:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d78c7d23800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:3.0:1789607762.662565:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d790133d880 x1876539150150656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607762.662580:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607762.662583:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607762.662585:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607762.662588:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607762.662607:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607762.662610:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607762.662623:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607762.662626:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789607762.662651:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150150528:0@lo:400:kworker.0 00000100:00100000:3.0:1789607762.662711:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607762.664477:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150150784:0@lo:400:kworker.0 00000100:00100000:3.0:1789607762.664536:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607762.664575:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607762.664582:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150151168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607762.664610:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607762.664639:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150150656:0@lo:38:kworker.0 00000100:00100000:3.0:1789607762.664661:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607762.664689:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150150912:0@lo:400:kworker.0 00000100:00100000:3.0:1789607762.664711:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607762.664729:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607762.664734:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150151040:0@lo:400:kworker.0 00000100:00100000:3.0:1789607762.664758:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607762.664789:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150150528 00000100:00100000:3.0:1789607762.664810:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150150528 00000100:00100000:3.0:1789607762.665096:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607762.665105:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+18:3468:x1876539150150528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607762.665150:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+18:3468:x1876539150150528:12345-0@lo:400:kworker.0 Request processed in 47us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607762.665157:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607762.665185:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150151168 00000100:00100000:3.0:1789607762.665188:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150151168 00000100:00100000:3.0:1789607762.665216:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150150656 00000100:00100000:3.0:1789607762.665219:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150150656 00000100:00100000:3.0:1789607762.665227:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150150912 00000100:00100000:3.0:1789607762.665229:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150150912 00000100:00100000:3.0:1789607762.665240:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607762.665245:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539150151168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607762.665274:0:21935:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607762.665311:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539150151168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607762.665316:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607762.665329:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789607762.665333:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3467:x1876539150150656:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789607762.665353:0:21935:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:3.0:1789607762.665386:0:21935:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbf1b6 00000004:00100000:3.0:1789607762.665398:0:21935:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789607762.665404:0:21935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1789607762.665599:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607762.665607:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150150912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607762.665643:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150150912:12345-0@lo:400:kworker.0 Request processed in 37us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607762.665649:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607762.665672:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150150784 00000100:00100000:3.0:1789607762.665676:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150150784 00000100:00100000:3.0:1789607762.665696:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150151040 00000100:00100000:3.0:1789607762.665698:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150151040 00000100:00100000:3.0:1789607762.665708:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607762.665713:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150150784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607762.665749:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150150784:12345-0@lo:400:kworker.0 Request processed in 35us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607762.665755:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607762.665767:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607762.665773:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150151040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607762.665812:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150151040:12345-0@lo:400:kworker.0 Request processed in 39us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607762.665817:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607762.666099:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150151168:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1789607762.666113:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d790133ed80 x1876539150150784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607762.666123:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150150784:0@lo:400:kworker.0 00010000:00080000:3.0:1789607762.666155:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d790133f480 x1876539150151040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607762.666164:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150151040:0@lo:400:kworker.0 00000100:00100000:3.0:1789607762.666173:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150150912:0@lo:400:kworker.0 00000100:00100000:3.0:1789607762.666204:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150150528:0@lo:400:kworker.0 00000100:00080000:2.0:1789607762.757396:0:21935:0:(import.c:65:import_set_state_nolock()) ffff8d78fe133000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607762.757560:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3467:x1876539150150656:12345-0@lo:38:kworker.0 Request processed in 92223us (92896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607762.757571:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789607762.760186:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789607762.760198:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789607762.760205:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789607762.760208:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c7d23800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789607762.760267:0:3467:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cd4af33a): req@ffff8d78cf7c5180 x1876539150143744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607762.760294:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150150656:0@lo:38:kworker.0 00000100:00100000:3.0:1789607762.760634:0:21973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607762.760670:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f31240 going to sleep for 11 seconds 00000100:00100000:2.0:1789607762.760718:0:22574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150143744 00000100:00100000:2.0:1789607762.760725:0:22574:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150143744 00000100:00100000:2.0:1789607762.760785:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789607762.760795:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:21973:x1876539150143744:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789607762.760922:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:21973:x1876539150143744:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 120us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607762.760930:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607762.761095:0:21973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21973:1876539150143744:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1789607762.761134:0:21973:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789607762.761175:0:21973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79df80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21973:1876539150151296:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789607762.761208:0:21973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607762.761247:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fb8039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607762.761374:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150151296 00000100:00100000:2.0:1789607762.761378:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150151296 00000100:00100000:2.0:1789607762.761410:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607762.761431:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21973:x1876539150151296:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789607762.761586:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21973:x1876539150151296:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 156us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607762.761593:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607762.761624:0:21973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79df80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21973:1876539150151296:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789607762.761693:0:21973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21973:1876539150151424:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789607762.761731:0:21973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607762.761746:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c8136b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607762.761759:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150151424 00000100:00100000:2.0:1789607762.761763:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150151424 00000100:00100000:2.0:1789607762.761781:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607762.761787:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21973:x1876539150151424:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789607762.761833:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21973:x1876539150151424:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 46us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607762.761839:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607762.761884:0:21973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21973:1876539150151424:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789607762.762122:0:21973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789607762.769017:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150151552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607762.769091:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789607762.770689:0:21973:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000100:00100000:0.0:1789607762.772323:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150151552 00000100:00100000:0.0:1789607762.772336:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150151552 00000100:00100000:0.0:1789607762.772396:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607762.772414:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539150151552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607762.772457:0:21935:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607762.772535:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539150151552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (3444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607762.772541:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789607762.772633:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150151552:0@lo:41:osp-pre-1-0.0 00000004:00080000:2.0:1789607762.772710:0:21973:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1789607762.772715:0:21973:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789607762.852427:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607763.878528:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789607764.850042:0:22992:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8bc63670 20000000:00000080:2.0:1789607764.850059:0:22992:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d78fdda8000 uarg=0000000000000000 20000000:01000000:2.0:1789607764.850091:0:22992:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789607764.850097:0:22992:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789607764.850102:0:22992:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789607764.853331:0:22993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1789607764.853508:0:22992:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789607764.859421:0:22992:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789607764.859534:0:22992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607764.859553:0:22992:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c0030e00/0xa26202d240fbf066 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf05f expref: 17 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607764.859561:0:22992:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf162 expref: 17 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607764.859568:0:22992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607764.859608:0:22992:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbf162 expref: 17 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607764.859623:0:22992:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf169 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbf162 expref: 17 pid: 21924 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607764.859638:0:22992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:22992:1876539150151680:0@lo:104: 00000100:00100000:2.0:1789607764.859700:0:22992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607764.859789:0:22992:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c0030e00/0xa26202d240fbf066 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbf05f expref: 17 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607764.859798:0:22992:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78c0030e00/0xa26202d240fbf066 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbf05f expref: 17 pid: 21925 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607764.859806:0:22992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:22992:1876539150151808:0@lo:104: 00000100:00100000:2.0:1789607764.859827:0:22992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607764.860565:0:22992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0868b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607764.860625:0:21913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150151680 00000100:00100000:0.0:1789607764.860633:0:21913:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150151680 00000100:00100000:1.0:1789607764.860695:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150151808 00000100:00100000:1.0:1789607764.860700:0:21914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150151808 00000100:00100000:1.0:1789607764.860724:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607764.860732:0:21914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+4:22992:x1876539150151680:12345-0@lo:104: 00010000:00010000:1.0:1789607764.860748:0:21914:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf169 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607764.860814:0:21914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789607764.860821:0:21914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+4:22992:x1876539150151680:12345-0@lo:104: Request processed in 90us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607764.860828:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607764.860845:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607764.860850:0:21914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:22992:x1876539150151808:12345-0@lo:104: 00010000:00010000:1.0:1789607764.860857:0:21914:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf066 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607764.860968:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607764.860976:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf169 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607764.861002:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76800 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607764.861006:0:21918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbf169 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607764.861014:0:21918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbf169 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607764.861021:0:21918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbf169 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607764.861026:0:21918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789607764.861059:0:21918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf169 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607764.861066:0:21918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607764.861084:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf169 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607764.861091:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf162 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf169 expref: -99 pid: 22567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607764.861104:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607764.861106:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607764.861108:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607764.861129:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150151936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607764.861161:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607764.861289:0:22992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:22992:1876539150151680:0@lo:104: 00010000:00010000:1.0:1789607764.861466:0:21914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789607764.861472:0:21914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:22992:x1876539150151808:12345-0@lo:104: Request processed in 622us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607764.861479:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607764.861519:0:21917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150151936 00000100:00100000:1.0:1789607764.861523:0:21917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150151936 00010000:00010000:1.0:1789607764.861549:0:21917:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf169 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf162 expref: 18 pid: 21924 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607764.861570:0:21917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607764.861576:0:21917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77c69b89-f077-4f20-ab40-68d85082562e+18:3470:x1876539150151936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607764.861588:0:21917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607764.861592:0:21917:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf169 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf162 expref: 18 pid: 21924 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607764.861603:0:21917:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbf162 expref: 18 pid: 21924 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607764.861618:0:21917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf169 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbf162 expref: 18 pid: 21924 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607764.861629:0:21917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607764.861657:0:21917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77c69b89-f077-4f20-ab40-68d85082562e+17:3470:x1876539150151936:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607764.861664:0:21917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607764.861688:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150151936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607764.861815:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607764.861821:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf066 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.861828:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:0.0:1789607764.861831:0:21919:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbf066 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.861839:0:21919:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbf066 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607764.861845:0:21919:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbf066 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607764.861850:0:21919:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789607764.862006:0:21919:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf066 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862013:0:21919:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607764.862033:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf066 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862052:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76600/0xa26202d240fbf05f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf066 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862066:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607764.862067:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607764.862069:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607764.862080:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607764.862090:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150152064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607764.862121:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607764.862148:0:21916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150152064 00000100:00100000:0.0:1789607764.862152:0:21916:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150152064 00010000:00010000:0.0:1789607764.862168:0:21916:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c0030e00/0xa26202d240fbf066 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf05f expref: 17 pid: 21925 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607764.862189:0:21916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789607764.862195:0:21916:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77c69b89-f077-4f20-ab40-68d85082562e+17:3470:x1876539150152064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607764.862203:0:21916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607764.862207:0:21916:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c0030e00/0xa26202d240fbf066 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf05f expref: 17 pid: 21925 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862216:0:21916:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c0030e00/0xa26202d240fbf066 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbf05f expref: 17 pid: 21925 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862229:0:21916:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862237:0:21916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862262:0:21916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862269:0:21916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862276:0:21916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862282:0:21916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862288:0:21916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59d600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607764.862292:0:21916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862299:0:21916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862308:0:21916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607764.862316:0:21916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607764.862344:0:21916:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77c69b89-f077-4f20-ab40-68d85082562e+17:3470:x1876539150152064:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607764.862351:0:21916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789607764.862379:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150152064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607764.862501:0:22992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c0030e00/0xa26202d240fbf066 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbf05f expref: 16 pid: 21925 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607764.862513:0:22992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:22992:1876539150151808:0@lo:104: 00010000:00010000:2.0:1789607764.862534:0:22992:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607764.862543:0:22992:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607764.862549:0:22992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607764.862555:0:22992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf1bd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607764.900257:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789607765.346727:0:21964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789607765.923182:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789607766.434035:0:21927:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789607766.434043:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d77c610b000 from 13 10000000:01000000:3.0:1789607766.434066:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607766.434111:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607766.434123:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607766.434149:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607766.434175:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150152192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607766.434254:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607766.434299:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9000 going to sleep for 11 seconds 00000100:00100000:2.0:1789607766.434378:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150152192 00000100:00100000:2.0:1789607766.434395:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150152192 00000100:00100000:2.0:1789607766.434448:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789607766.434456:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+16:21927:x1876539150152192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607766.434468:0:21925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607766.434491:0:21925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59d200/0xa26202d240fbf1cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf1c4 expref: -99 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607766.434515:0:21925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59d200/0xa26202d240fbf1cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf1c4 expref: 17 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607766.434525:0:21925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59d200/0xa26202d240fbf1cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf1c4 expref: 17 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607766.434545:0:21925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59d200, rc 0) 00000100:00100000:2.0:1789607766.434596:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+17:21927:x1876539150152192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607766.434602:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789607766.434938:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150152192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607766.434961:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1cb expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607766.434971:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf1cb expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607766.435024:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150152320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607766.435053:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607766.435087:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fb803780 going to sleep for 11 seconds 00000100:00100000:1.0:1789607766.435156:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150152320 00000100:00100000:1.0:1789607766.435161:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150152320 00000100:00100000:1.0:1789607766.435195:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789607766.435203:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+17:21927:x1876539150152320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607766.435455:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+17:21927:x1876539150152320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607766.435463:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789607766.435689:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150152320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607766.435729:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150152448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607766.435769:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607766.435791:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fb803780 going to sleep for 11 seconds 00000100:00100000:3.0:1789607766.435920:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150152448 00000100:00100000:3.0:1789607766.435925:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150152448 00000100:00100000:3.0:1789607766.436027:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789607766.436035:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+17:21927:x1876539150152448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607766.436189:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+17:21927:x1876539150152448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607766.436197:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789607766.436266:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150152448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789607766.439115:0:23061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789607766.439198:0:21927:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789607766.439213:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789607766.439460:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1cb expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607766.439482:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1cb expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607766.439493:0:21927:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789607766.439496:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78c2f72000 from 13 10000000:01000000:0.0:1789607766.439499:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789607766.439537:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607766.439557:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607766.439568:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607766.439591:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150152576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789607766.439652:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607766.439698:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fb803900 going to sleep for 11 seconds 00000100:00100000:1.0:1789607766.439987:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150152576 00000100:00100000:1.0:1789607766.439994:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150152576 00000100:00100000:1.0:1789607766.440033:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789607766.440042:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+17:21927:x1876539150152576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607766.440055:0:21923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607766.440066:0:21923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbf1d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf1d2 expref: -99 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607766.440089:0:21923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbf1d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf1d2 expref: 18 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607766.440099:0:21923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbf1d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf1d2 expref: 18 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607766.440107:0:21923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77000, rc 0) 00000100:00100000:1.0:1789607766.440163:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+18:21927:x1876539150152576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607766.440169:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789607766.440673:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150152576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607766.440693:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1d9 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607766.440702:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf1d9 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607766.440772:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150152704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607766.440805:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607766.440837:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fb803900 going to sleep for 11 seconds 00000100:00100000:1.0:1789607766.440967:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150152704 00000100:00100000:1.0:1789607766.440972:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150152704 00000100:00100000:1.0:1789607766.441003:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789607766.441011:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+18:21927:x1876539150152704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607766.441270:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+18:21927:x1876539150152704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607766.441277:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789607766.441740:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150152704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607766.441766:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150152832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607766.441797:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607766.441811:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fb803900 going to sleep for 11 seconds 00000100:00100000:1.0:1789607766.442113:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150152832 00000100:00100000:1.0:1789607766.442119:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150152832 00000100:00100000:1.0:1789607766.442150:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789607766.442157:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+18:21927:x1876539150152832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607766.442914:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+18:21927:x1876539150152832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 753us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607766.442923:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789607766.443118:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150152832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789607766.449304:0:23062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789607766.450142:0:21927:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789607766.450178:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607766.450193:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1d9 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607766.450207:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1d9 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607766.948802:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607767.783047:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607757/real 1789607757] req@ffff8d78cf7c6d80 x1876539150146816/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607767.783075:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78cf7c6d80 x1876539150146816/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607767.783086:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607757/real 1789607757] req@ffff8d78cf7c4700 x1876539150146688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607767.783097:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78cf7c4700 x1876539150146688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789607767.783115:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f06c2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607767.783136:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789607767.783140:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150146816:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789607767.783146:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78ef1f0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607767.783151:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789607767.783154:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150146688:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789607767.783188:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607767.783199:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150152960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607767.783256:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607767.783674:0:22574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150152960 00000100:00100000:0.0:1789607767.783688:0:22574:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150152960 00000100:00080000:2.0:1789607767.783903:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607767.783907:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607767.783910:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607767.783913:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607767.783938:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607767.783942:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789607767.783945:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78ef1f0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789607767.783949:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 662 00000100:00080000:2.0:1789607767.783954:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789607767.783962:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d78ef1f0800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607767.783983:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78c61ffb80 x1876539150153472/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789607767.784004:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607767.784008:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789607767.784010:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78f06c2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789607767.784013:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 662 00000100:00080000:2.0:1789607767.784016:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789607767.784022:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d78f06c2800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607767.784035:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78c61ff100 x1876539150153600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607767.784143:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77c69b89-f077-4f20-ab40-68d85082562e:3469:1876539150153088:0@lo:400:kworker.0 00000100:00100000:2.0:1789607767.784181:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607767.784208:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607767.784214:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150153728:0@lo:400:kworker.0 00000100:00100000:2.0:1789607767.784236:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607767.784260:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150153472:0@lo:8:kworker.0 00000400:00000100:2.0:1789607767.784288:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150153472 offset 0 length 520: 4 00000100:00100000:2.0:1789607767.784302:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150153600:0@lo:8:kworker.0 00000400:00000100:2.0:1789607767.784321:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150153600 offset 0 length 520: 4 00000100:00100000:2.0:1789607767.785221:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150153088 00000100:00100000:2.0:1789607767.785231:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150153088 00000100:00100000:2.0:1789607767.785274:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789607767.785284:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+18:3469:x1876539150153088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607767.785346:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+18:3469:x1876539150153088:12345-0@lo:400:kworker.0 Request processed in 64us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607767.785363:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789607767.785415:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77c69b89-f077-4f20-ab40-68d85082562e:3469:1876539150153088:0@lo:400:kworker.0 00000100:00100000:2.0:1789607767.785642:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150153728 00000100:00100000:2.0:1789607767.785646:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150153728 00000100:00100000:2.0:1789607767.785673:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607767.785679:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150153728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607767.785716:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150153728:12345-0@lo:400:kworker.0 Request processed in 38us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607767.785722:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607767.785790:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150153856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607767.785818:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789607767.788336:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78c61fd180 x1876539150153728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607767.788353:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150153728:0@lo:400:kworker.0 00000100:00100000:0.0:1789607767.792370:0:22574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150153856 00000100:00100000:0.0:1789607767.792386:0:22574:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150153856 00000100:00100000:0.0:1789607767.792421:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150153216:0@lo:400:kworker.0 00000100:00100000:0.0:1789607767.792490:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607767.792536:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607767.792543:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150153344:0@lo:400:kworker.0 00000100:00100000:0.0:1789607767.792568:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607767.792613:0:22574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150153344 00000100:00100000:0.0:1789607767.792616:0:22574:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150153344 00000100:00100000:0.0:1789607767.792630:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607767.792640:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539150152960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607767.792680:0:22574:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607767.792726:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539150152960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (9468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607767.792732:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607767.792749:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607767.792755:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539150153856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789607767.792773:0:22574:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607767.792802:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539150153856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (6983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607767.792808:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607767.792819:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789607767.792826:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150153344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607767.792900:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150153344:12345-0@lo:400:kworker.0 Request processed in 75us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607767.792906:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789607767.792957:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150153344:0@lo:400:kworker.0 00000100:00100000:2.0:1789607767.793249:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150153216 00000100:00100000:2.0:1789607767.793255:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150153216 00000100:00100000:2.0:1789607767.793286:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607767.793294:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150153216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607767.793339:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150153216:12345-0@lo:400:kworker.0 Request processed in 46us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607767.793346:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607767.793381:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150153856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789607767.793396:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150152960:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1789607767.793428:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78c61fe300 x1876539150153216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607767.793446:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150153216:0@lo:400:kworker.0 00000001:00100000:2.0:1789607767.847162:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789607767.971022:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607768.802038:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607753/real 1789607753] req@ffff8d78ff79f480 x1876539150144896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607768 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607768.802076:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78ff79f480 x1876539150144896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607768 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607768.802086:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607753/real 1789607753] req@ffff8d78ff79ca80 x1876539150145024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607768 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607768.802098:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78ff79ca80 x1876539150145024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607768 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789607768.802116:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fcd69000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607768.802138:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789607768.802142:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150144896:0@lo:8:kworker.0 00000100:00080000:2.0:1789607768.802147:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c7c35800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607768.802152:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789607768.802155:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150145024:0@lo:8:kworker.0 00000100:00080000:1.0:1789607768.802409:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607768.802413:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789607768.802425:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d78fcd69000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607768.802430:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 658 00000100:00080000:1.0:1789607768.802436:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789607768.802446:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d78fcd69000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607768.802465:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cf7c6300 x1876539150154240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607768.802478:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607768.802481:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789607768.802482:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d78c7c35800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607768.802486:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 658 00000100:00080000:1.0:1789607768.802488:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789607768.802492:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d78c7c35800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607768.802504:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cf7c4000 x1876539150154368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607768.802533:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607768.802537:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789607768.802539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607768.802542:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789607768.802565:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150154112:0@lo:400:kworker.0 00000100:00100000:1.0:1789607768.802623:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607768.802657:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789607768.802663:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77c69b89-f077-4f20-ab40-68d85082562e:3471:1876539150153984:0@lo:400:kworker.0 00000100:00100000:1.0:1789607768.802688:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607768.802712:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150154752:0@lo:400:kworker.0 00000100:00100000:1.0:1789607768.802748:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607768.802778:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150153984 00000100:00100000:1.0:1789607768.802785:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150153984 00000100:00100000:1.0:1789607768.802823:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789607768.802830:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+18:3471:x1876539150153984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607768.802900:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+18:3471:x1876539150153984:12345-0@lo:400:kworker.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607768.802907:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789607768.802933:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150154752 00000100:00100000:1.0:1789607768.802937:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150154752 00000100:00100000:1.0:1789607768.802969:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607768.802976:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150154752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607768.803006:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150154752:12345-0@lo:400:kworker.0 Request processed in 31us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607768.803012:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607768.803038:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77c69b89-f077-4f20-ab40-68d85082562e:3471:1876539150153984:0@lo:400:kworker.0 00010000:00080000:1.0:1789607768.803049:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78cf7c5180 x1876539150154752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607768.803058:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150154752:0@lo:400:kworker.0 00000100:00100000:2.0:1789607768.805086:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150154496:0@lo:400:kworker.0 00000100:00100000:2.0:1789607768.805147:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607768.805192:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607768.805200:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150154624:0@lo:400:kworker.0 00000100:00100000:2.0:1789607768.805225:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607768.805249:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150154496 00000100:00100000:1.0:1789607768.805257:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150154496 00000100:00100000:2.0:1789607768.805264:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150154112 00000100:00100000:2.0:1789607768.805278:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150154112 00000100:00100000:1.0:1789607768.805296:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607768.805299:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150154624 00000100:00100000:2.0:1789607768.805301:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150154624 00000100:00100000:1.0:1789607768.805303:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150154496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607768.805312:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607768.805316:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150154112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607768.806084:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150154496:12345-0@lo:400:kworker.0 Request processed in 777us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607768.806104:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789607768.810625:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78cf7c5f80 x1876539150154496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607768.810643:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150154496:0@lo:400:kworker.0 00000100:00100000:0.0:1789607768.810785:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789607768.810801:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150154624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607768.810913:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150154624:12345-0@lo:400:kworker.0 Request processed in 119us (5686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607768.810920:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789607768.812716:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150154624:0@lo:400:kworker.0 00000100:00100000:0.0:1789607768.813934:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150154240:0@lo:8:kworker.0 00000400:00000100:0.0:1789607768.813987:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150154240 offset 0 length 520: 4 00000100:00100000:0.0:1789607768.814033:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150154368:0@lo:8:kworker.0 00000400:00000100:0.0:1789607768.814062:0:3467:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539150154368 offset 0 length 520: 4 00000100:00100000:2.0:1789607768.814678:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150154112:12345-0@lo:400:kworker.0 Request processed in 9357us (12051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607768.814690:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607768.814750:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150154112:0@lo:400:kworker.0 00010000:00010000:1.0:1789607768.994083:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789607769.562186:0:23243:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789607769.562190:0:23243:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789607769.562299:0:23243:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d77c4ba1000 00000020:01000004:1.0:1789607769.562315:0:23243:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789607769.562329:0:23243:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789607769.562343:0:23243:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d78f05b4d40) 00000020:00000080:1.0:1789607769.562360:0:23243:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789607769.604961:0:23243:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789607769.605219:0:23243:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789607769.606026:0:23243:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789607769.606269:0:23243:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789607769.606515:0:23243:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1789607769.606858:0:23243:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 653: rc = 0 00100000:10000000:2.0:1789607769.620710:0:23243:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 653: rc = 0 00100000:10000000:2.0:1789607769.620826:0:23243:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 653: rc = 0 00100000:10000000:2.0:1789607769.621593:0:23243:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 441: rc = 0 00100000:10000000:2.0:1789607769.621955:0:23243:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 441: rc = 0 00100000:10000000:2.0:1789607769.622466:0:23243:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 441: rc = 0 00100000:10000000:2.0:1789607769.622942:0:23243:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 441: rc = 0 00100000:10000000:2.0:1789607769.623513:0:23243:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 441: rc = 0 00100000:10000000:2.0:1789607769.625515:0:23243:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 441: rc = 0 00000020:00000080:2.0:1789607769.628454:0:23243:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789607769.628469:0:23243:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789607769.628480:0:23243:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa26202d240fbf1e7 00000020:01000004:2.0:1789607769.628499:0:23243:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789607769.628521:0:23243:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789607769.628525:0:23243:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789607769.628531:0:23243:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789607769.628536:0:23243:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789607769.628548:0:23243:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d78ef1619c0) 00000020:00000080:2.0:1789607769.628559:0:23243:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789607769.632349:0:23243:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607769.632542:0:23243:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789607769.632549:0:23243:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789607769.635700:0:23243:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789607769.635714:0:23243:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789607769.636413:0:23243:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789607769.636421:0:23243:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789607769.645787:0:23243:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607769.648380:0:23243:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789607769.648388:0:23243:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789607769.649133:0:23243:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789607769.649142:0:23243:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789607769.667540:0:23243:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607769.668179:0:23243:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789607769.668187:0:23243:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789607769.669842:0:23243:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789607769.669855:0:23243:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789607769.675388:0:23243:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789607769.675403:0:23243:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789607769.680255:0:23243:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789607769.680458:0:23243:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789607769.680464:0:23243:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789607769.688094:0:23243:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789607769.688141:0:23243:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000040:00080000:0.0:1789607769.762697:0:22590:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789607769.768198:0:23243:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607769.768405:0:23243:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789607769.768414:0:23243:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789607769.770163:0:23243:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789607769.770174:0:23243:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789607769.771655:0:23243:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789607769.771708:0:23243:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789607769.771715:0:23243:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789607769.797128:0:23243:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789607769.797176:0:23243:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.125@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789607769.797180:0:23243:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789607769.797181:0:23243:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789607769.797183:0:23243:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607769.797184:0:23243:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607769.797185:0:23243:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607769.797187:0:23243:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607769.797188:0:23243:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607769.797189:0:23243:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607769.797191:0:23243:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789607769.797194:0:23243:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789607769.797197:0:23243:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789607769.797198:0:23243:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789607769.797199:0:23243:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607769.797200:0:23243:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607769.797201:0:23243:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607769.797202:0:23243:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607769.797203:0:23243:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607769.797203:0:23243:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607769.797205:0:23243:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789607769.797231:0:23243:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789607769.797252:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150154880:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789607769.797328:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607769.797380:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c392e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789607769.798654:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150154880 00000100:00100000:1.0:1789607769.798667:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150154880 00000100:00100000:1.0:1789607769.798802:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789607769.798812:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f634a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+18:23243:x1876539150154880:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789607769.798845:0:21923:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789607769.798849:0:21923:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789607769.798853:0:21923:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789607769.825395:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f634a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+18:23243:x1876539150154880:12345-0@lo:253:mount.lustre.0 Request processed in 26573us (28055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607769.825410:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789607769.825524:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150154880:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789607769.825541:0:23243:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789607769.825544:0:23243:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607769.825545:0:23243:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789607769.825547:0:23243:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607769.825548:0:23243:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607769.825549:0:23243:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607769.825550:0:23243:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607769.825551:0:23243:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607769.825553:0:23243:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607769.825555:0:23243:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789607769.825575:0:23243:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d77c4ba1000 from lustre-OST0000 10000000:01000000:2.0:1789607769.825620:0:23243:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789607769.825623:0:23243:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789607769.825632:0:23243:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d78c5b919c0 local copy 00010000:00010000:2.0:1789607769.825642:0:23243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefa9 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607769.825902:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607769.825939:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607769.825969:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0f3c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789607769.826032:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150155008 00000100:00100000:0.0:1789607769.826039:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150155008 00000100:00100000:0.0:1789607769.826077:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789607769.826086:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+18:23243:x1876539150155008:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607769.826467:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+18:23243:x1876539150155008:12345-0@lo:501:mount.lustre.0 Request processed in 381us (526us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789607769.826484:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789607769.826631:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155008:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789607769.826648:0:23243:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789607769.826807:0:23243:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789607769.826815:0:23243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefa9 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607769.826825:0:23243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefa9 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607769.826906:0:23243:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d77c4ba1000 10000000:01000000:2.0:1789607769.826911:0:23243:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789607769.826916:0:23243:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789607769.826919:0:23243:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789607769.826923:0:23243:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789607769.826927:0:23243:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789607769.826953:0:23243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c800/0xa26202d240fbf1f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607769.826961:0:23243:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c800/0xa26202d240fbf1f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607769.826970:0:23243:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c800/0xa26202d240fbf1f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607769.826986:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607769.827020:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607769.827053:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0f3c000 going to sleep for 11 seconds 00000100:00100000:1.0:1789607769.827151:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150155136 00000100:00100000:1.0:1789607769.827157:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150155136 00000100:00100000:3.0:1789607769.827392:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789607769.827405:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+18:23243:x1876539150155136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607769.827416:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607769.827429:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7900ef8000/0xa26202d240fbf1fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf1f5 expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607769.827454:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef8000/0xa26202d240fbf1fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf1f5 expref: 19 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607769.827464:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7900ef8000/0xa26202d240fbf1fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf1f5 expref: 19 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607769.827471:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8000, rc 0) 00000100:00100000:3.0:1789607769.827516:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+19:23243:x1876539150155136:12345-0@lo:101:mount.lustre.0 Request processed in 115us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607769.827522:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789607769.827664:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607769.827680:0:23243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c800/0xa26202d240fbf1f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1fc expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607769.827689:0:23243:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c800/0xa26202d240fbf1f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf1fc expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789607769.828523:0:23243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1789607769.832619:0:23243:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607769.835605:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789607769.835693:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789607769.835728:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789607769.835778:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789607769.835815:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789607769.835890:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789607769.835973:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789607769.836010:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789607769.836042:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1789607769.836090:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1789607769.836125:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1789607769.836173:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1789607769.836252:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1789607769.836260:0:23243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1789607769.836371:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607769.836437:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607769.836472:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e067a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789607769.837209:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150155264 00000100:00100000:0.0:1789607769.837219:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150155264 00000100:00100000:0.0:1789607769.837274:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789607769.837284:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+19:23243:x1876539150155264:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607769.837848:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+19:23243:x1876539150155264:12345-0@lo:501:mount.lustre.0 Request processed in 556us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607769.837857:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789607769.846145:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607769.846214:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607769.846294:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607769.846340:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0d1c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789607769.846410:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150155392 00000100:00100000:2.0:1789607769.846418:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150155392 00000100:00100000:2.0:1789607769.846468:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789607769.846477:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+19:23243:x1876539150155392:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607769.846815:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+19:23243:x1876539150155392:12345-0@lo:503:mount.lustre.0 Request processed in 337us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607769.846823:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789607769.847571:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155392:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789607769.848361:0:23243:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789607769.848438:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607769.848506:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607769.848536:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d0d1c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789607769.849158:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150155520 00000100:00100000:3.0:1789607769.849168:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150155520 00000100:00100000:3.0:1789607769.849227:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789607769.849236:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+19:23243:x1876539150155520:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607769.849467:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+19:23243:x1876539150155520:12345-0@lo:502:mount.lustre.0 Request processed in 232us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607769.849476:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789607769.850579:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155520:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607769.860085:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789607769.860214:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1789607769.860257:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1789607769.860317:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1789607769.860355:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1789607769.860386:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1789607769.860467:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1789607769.860505:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1789607769.860538:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1789607769.860586:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1789607769.860621:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1789607769.860670:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1789607769.860722:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607769.860802:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607769.860963:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607769.864379:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150155648 00000100:00100000:3.0:1789607769.864394:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150155648 00000100:00100000:3.0:1789607769.864461:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789607769.864473:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+19:23243:x1876539150155648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607769.864735:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+19:23243:x1876539150155648:12345-0@lo:502:mount.lustre.0 Request processed in 263us (3932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607769.864742:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789607769.866426:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607769.866577:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1789607769.866592:0:23243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1789607769.874529:0:23257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789607769.874541:0:23257:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789607769.874549:0:23257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607769.874551:0:23257:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789607769.874556:0:23257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789607769.874571:0:23257:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d78f05b3380) 00000020:00000080:1.0:1789607769.874596:0:23257:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789607769.874602:0:23257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789607769.874676:0:23257:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d77c4ba1000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789607769.874685:0:23257:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789607769.874693:0:23257:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa26202d240fbf20a 00010000:00010000:1.0:1789607769.878807:0:23257:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1789607769.879685:0:23257:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1789607769.882471:0:23257:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1789607769.889627:0:23257:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789607769.889642:0:23257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607769.889648:0:23257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607769.889656:0:23257:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789607769.889661:0:23257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789607769.889664:0:23257:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1789607769.889666:0:23257:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789607769.889667:0:23257:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789607769.889669:0:23257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789607769.889672:0:23257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607769.889673:0:23257:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789607769.889675:0:23257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607769.889679:0:23257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607769.889680:0:23257:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789607769.889682:0:23257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789607769.889684:0:23257:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789607769.889686:0:23257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607769.889689:0:23257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607769.889690:0:23257:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789607769.889692:0:23257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607769.889694:0:23257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607769.889695:0:23257:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789607769.889698:0:23257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789607769.889761:0:23257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607769.889765:0:23257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607769.889767:0:23257:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789607769.889770:0:23257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1789607769.900909:0:23243:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789607769.900952:0:23243:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789607769.900973:0:23243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c800/0xa26202d240fbf1f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1fc expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607769.900986:0:23243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c800/0xa26202d240fbf1f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf1fc expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607769.900995:0:23243:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d77c4ba1000 from 1 10000000:01000000:0.0:1789607769.900998:0:23243:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789607769.901031:0:23243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607769.901039:0:23243:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607769.901049:0:23243:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607769.901072:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155776:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789607769.901136:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607769.901174:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607769.901219:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150155776 00000100:00100000:0.0:1789607769.901225:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150155776 00000100:00100000:0.0:1789607769.901270:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789607769.901278:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+19:23243:x1876539150155776:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607769.901290:0:21925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607769.901301:0:21925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c3f65a00/0xa26202d240fbf218 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf211 expref: -99 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607769.901323:0:21925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c3f65a00/0xa26202d240fbf218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf211 expref: 20 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607769.901346:0:21925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c3f65a00/0xa26202d240fbf218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf211 expref: 20 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607769.901354:0:21925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c3f65a00, rc 0) 00000100:00100000:0.0:1789607769.901390:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+20:23243:x1876539150155776:12345-0@lo:101:mount.lustre.0 Request processed in 113us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607769.901397:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789607769.901443:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607769.901458:0:23243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf218 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607769.901467:0:23243:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf218 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607769.902017:0:23243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1789607769.902421:0:23243:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607769.902647:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789607769.902689:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789607769.902743:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789607769.902783:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789607769.902843:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789607769.902937:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789607769.902976:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789607769.903010:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1789607769.903055:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1789607769.903092:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1789607769.903128:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1789607769.903199:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1789607769.903215:0:23243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1789607769.903289:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607769.903350:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607769.903374:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607769.903857:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150155904 00000100:00100000:1.0:1789607769.903888:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150155904 00000100:00100000:1.0:1789607769.903929:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789607769.903937:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+20:23243:x1876539150155904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607769.904148:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+20:23243:x1876539150155904:12345-0@lo:501:mount.lustre.0 Request processed in 211us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607769.904156:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789607769.905011:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150155904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607769.905061:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607769.905115:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607769.905432:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfcf9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607769.912679:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150156032 00000100:00100000:2.0:1789607769.912692:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150156032 00000100:00100000:2.0:1789607769.912787:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789607769.912799:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+20:23243:x1876539150156032:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607769.913072:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+20:23243:x1876539150156032:12345-0@lo:503:mount.lustre.0 Request processed in 274us (7955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607769.913081:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789607769.913341:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156032:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789607769.914546:0:23243:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789607769.914629:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156160:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607769.914698:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607769.930973:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150156160 00000100:00100000:0.0:1789607769.930988:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150156160 00000100:00100000:0.0:1789607769.931039:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789607769.931048:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+20:23243:x1876539150156160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607769.931315:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+20:23243:x1876539150156160:12345-0@lo:502:mount.lustre.0 Request processed in 266us (16615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607769.931323:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789607769.937523:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607769.937567:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789607769.937914:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789607769.939096:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789607769.939199:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789607769.939240:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789607769.939285:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789607769.939341:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789607769.939408:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789607769.939443:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1789607769.939493:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789607769.939527:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1789607769.941643:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1789607769.941715:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607769.941807:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607769.942962:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2600 going to sleep for 11 seconds 00000100:00100000:0.0:1789607769.948444:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150156288 00000100:00100000:0.0:1789607769.948472:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150156288 00000100:00100000:1.0:1789607769.949056:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789607769.949085:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+20:23243:x1876539150156288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607769.949361:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+20:23243:x1876539150156288:12345-0@lo:502:mount.lustre.0 Request processed in 279us (7554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607769.949369:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789607769.949526:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789607769.949678:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1789607769.949694:0:23243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789607769.951738:0:23261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607769.951749:0:23261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607769.951752:0:23261:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789607769.951758:0:23261:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d77c4ba1000 00000020:00000080:2.0:1789607769.951760:0:23261:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607769.951768:0:23261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607769.951770:0:23261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607769.951772:0:23261:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789607769.951774:0:23261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607769.951776:0:23261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607769.951790:0:23261:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789607769.951795:0:23261:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d77c4ba1000 00000020:00000080:2.0:1789607769.951797:0:23261:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607769.951885:0:23261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607769.951890:0:23261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607769.951892:0:23261:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789607769.951895:0:23261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607769.951898:0:23261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607769.951900:0:23261:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789607769.951904:0:23261:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d77c4ba1000 00000020:00000080:2.0:1789607769.951906:0:23261:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607769.951927:0:23261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607769.951930:0:23261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607769.951931:0:23261:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789607769.951934:0:23261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607769.951936:0:23261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607769.951937:0:23261:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789607769.951941:0:23261:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d77c4ba1000 00000020:00000080:2.0:1789607769.951943:0:23261:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607769.951995:0:23261:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607769.951999:0:23261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607769.952000:0:23261:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789607769.952003:0:23261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1789607769.952203:0:23243:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789607769.952238:0:23243:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607769.952261:0:23243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf218 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607769.952273:0:23243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf218 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607769.952321:0:23243:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789607769.952324:0:23243:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d77c4ba1000 10000000:01000000:3.0:1789607769.952328:0:23243:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d77c4ba1000 10000000:01000000:3.0:1789607769.952333:0:23243:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789607769.952338:0:23243:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d77c4ba1000 from 1 10000000:01000000:3.0:1789607769.952341:0:23243:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789607769.952378:0:23243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8200/0xa26202d240fbf21f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607769.952386:0:23243:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8200/0xa26202d240fbf21f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607769.952398:0:23243:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8200/0xa26202d240fbf21f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607769.952434:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789607769.952502:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607769.952541:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607769.952564:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150156416 00000100:00100000:3.0:1789607769.952571:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150156416 00000100:00100000:3.0:1789607769.952622:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789607769.952632:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+20:23243:x1876539150156416:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607769.952645:0:21923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607769.952659:0:21923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7900ef9a00/0xa26202d240fbf226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf21f expref: -99 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607769.952684:0:21923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef9a00/0xa26202d240fbf226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf21f expref: 21 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607769.952694:0:21923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7900ef9a00/0xa26202d240fbf226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf21f expref: 21 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607769.952703:0:21923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9a00, rc 0) 00000100:00100000:3.0:1789607769.952742:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:23243:x1876539150156416:12345-0@lo:101:mount.lustre.0 Request processed in 113us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607769.952748:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789607769.952796:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607769.952809:0:23243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8200/0xa26202d240fbf21f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf226 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607769.952817:0:23243:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8200/0xa26202d240fbf21f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf226 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607769.953617:0:23243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1789607769.953969:0:23243:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607769.954263:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789607769.954308:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789607769.954344:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789607769.954406:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789607769.954472:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789607769.954547:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789607769.954599:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789607769.954639:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789607769.954709:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789607769.954746:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789607769.954781:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789607769.954833:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789607769.954907:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789607769.954944:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789607769.954995:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789607769.955036:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789607769.955074:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789607769.955135:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789607769.955181:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789607769.955224:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789607769.955284:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789607769.955330:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789607769.955373:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789607769.955434:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789607769.955493:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1789607769.955528:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1789607769.955582:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1789607769.955625:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1789607769.955667:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1789607769.955737:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1789607769.955774:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1789607769.955809:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1789607769.955844:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1789607769.967326:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1789607769.967399:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1789607769.967453:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1789607769.967493:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1789607769.967527:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1789607769.967597:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1789607769.967653:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1789607769.967726:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1789607769.967783:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1789607769.967846:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1789607769.967920:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1789607769.967962:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1789607769.968007:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1789607769.968042:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1789607769.968074:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1789607769.968168:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1789607769.968209:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1789607769.968272:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1789607769.968280:0:23243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1789607769.968387:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607769.968454:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607769.968508:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607769.968770:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150156544 00000100:00100000:0.0:1789607769.968780:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150156544 00000100:00100000:0.0:1789607769.968825:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789607769.968835:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+21:23243:x1876539150156544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607769.969083:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+21:23243:x1876539150156544:12345-0@lo:501:mount.lustre.0 Request processed in 249us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607769.969092:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789607769.974387:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607769.974444:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156672:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607769.974512:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607769.974559:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607769.974587:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150156672 00000100:00100000:0.0:1789607769.974595:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150156672 00000100:00100000:0.0:1789607769.974652:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789607769.974678:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+21:23243:x1876539150156672:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607769.975055:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607769.975055:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+21:23243:x1876539150156672:12345-0@lo:503:mount.lustre.0 Request processed in 374us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607769.975070:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000040:00080000:3.0:1789607769.975706:0:23243:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789607769.975774:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607769.975819:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607769.975886:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607769.976050:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150156800 00000100:00100000:0.0:1789607769.976056:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150156800 00000100:00100000:0.0:1789607769.976095:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789607769.976103:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:23243:x1876539150156800:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607769.976527:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:23243:x1876539150156800:12345-0@lo:502:mount.lustre.0 Request processed in 424us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607769.976536:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789607769.980002:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607769.980310:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789607769.980387:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1789607769.980423:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1789607769.980471:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1789607769.980509:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1789607769.980559:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1789607769.980595:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1789607769.980625:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1789607769.980673:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1789607769.980712:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1789607769.980746:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1789607769.980797:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1789607769.980834:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1789607769.980910:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1789607769.980963:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1789607769.980998:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1789607769.981029:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1789607769.981094:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1789607769.981131:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1789607769.981163:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1789607769.981208:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1789607769.981245:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1789607769.981279:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1789607769.981339:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1789607769.981381:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1789607769.981410:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1789607769.981457:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1789607769.981490:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1789607769.981522:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1789607769.981567:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1789607769.981602:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1789607769.981633:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1789607769.981664:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1789607769.981726:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1789607769.981763:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1789607769.981812:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1789607769.981851:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789607769.983612:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789607769.983696:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789607769.983753:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789607769.983790:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789607769.983822:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789607769.983908:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789607769.983944:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789607769.983984:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789607769.984032:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789607769.984071:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789607769.984101:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789607769.984172:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607769.984252:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607769.984299:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607769.984320:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150156928 00000100:00100000:0.0:1789607769.984329:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150156928 00000100:00100000:0.0:1789607769.984377:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789607769.984387:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+21:23243:x1876539150156928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607769.984612:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+21:23243:x1876539150156928:12345-0@lo:502:mount.lustre.0 Request processed in 226us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607769.984620:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789607769.984709:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150156928:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607769.984805:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1789607769.984851:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1789607769.984926:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150157056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607769.984965:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607769.984990:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607769.985136:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150157056 00000100:00100000:0.0:1789607769.985142:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150157056 00000100:00100000:0.0:1789607769.985177:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789607769.985186:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:23243:x1876539150157056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607769.985325:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:23243:x1876539150157056:12345-0@lo:502:mount.lustre.0 Request processed in 141us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607769.985333:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789607769.985923:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150157056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607769.986059:0:23243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1789607769.986072:0:23243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789607769.990059:0:23266:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789607769.990083:0:23266:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d78e9ee99c0) 00000020:00000080:0.0:1789607769.990106:0:23266:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789607769.990429:0:23266:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d77c4ba1000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789607769.990435:0:23266:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d77c4ba1000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789607769.990438:0:23266:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d77c4ba1000 3 00010000:00080000:0.0:1789607769.990471:0:23266:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d77c5715000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.125@tcp at head 00010000:00010000:0.0:1789607769.992775:0:23266:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1789607769.993030:0:23266:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789607769.993068:0:23266:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789607769.993080:0:23266:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa26202d240fbf234 00000100:00080000:0.0:1789607769.993091:0:23266:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607769.993101:0:23266:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d77c5715000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607769.993134:0:23266:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78ff79f100 x1876539150157184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607769.993235:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539150157184:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789607769.993305:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789607769.993430:0:23266:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789607769.993485:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607769.993489:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607769.993492:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607769.993495:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607769.993525:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607769.993529:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607769.993532:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607769.993535:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789607769.993565:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150157312:0@lo:400:kworker.0 00000100:00100000:0.0:1789607769.993598:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607769.993635:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607769.993644:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150157696:0@lo:400:kworker.0 00000100:00100000:0.0:1789607769.993671:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607769.993717:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150157568:0@lo:400:kworker.0 00000100:00100000:0.0:1789607769.993742:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607769.993758:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607769.993764:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150157440:0@lo:400:kworker.0 00000100:00100000:0.0:1789607769.993785:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607769.993820:0:22574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150157312 00000100:00100000:1.0:1789607769.993822:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150157184 00000100:00100000:0.0:1789607769.993827:0:22574:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150157312 00000100:00100000:1.0:1789607769.993830:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150157184 00000100:00100000:1.0:1789607769.993856:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150157696 00000100:00100000:1.0:1789607769.993886:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150157696 00000100:00100000:1.0:1789607769.993908:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150157440 00000100:00100000:1.0:1789607769.993911:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150157440 00000100:00100000:1.0:1789607769.993926:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607769.993935:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150157696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607769.993948:0:22574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150157568 00000100:00100000:0.0:1789607769.993954:0:22574:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150157568 00000100:00100000:0.0:1789607769.993989:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607769.993999:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150157696:12345-0@lo:400:kworker.0 Request processed in 64us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607769.993999:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150157312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607769.994013:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607769.994045:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150157312:12345-0@lo:400:kworker.0 Request processed in 49us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607769.994053:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789607769.994072:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789607769.994078:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150157568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607769.994115:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150157568:12345-0@lo:400:kworker.0 Request processed in 37us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607769.994121:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607769.994186:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607769.994196:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150157440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607769.994227:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150157440:12345-0@lo:400:kworker.0 Request processed in 33us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607769.994233:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607769.994246:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607769.994250:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3467:x1876539150157184:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789607769.994271:0:21932:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:1.0:1789607769.994307:0:21932:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa26202d240fbf23b 00000004:00100000:1.0:1789607769.994321:0:21932:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789607769.994354:0:21932:0:(import.c:65:import_set_state_nolock()) ffff8d77c6196800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1789607769.995177:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78ff79c000 x1876539150157440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607769.995361:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3467:x1876539150157184:12345-0@lo:38:llog_process_th.0 Request processed in 1107us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607769.995371:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789607769.995414:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78ff79ca80 x1876539150157696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607769.995425:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150157696:0@lo:400:kworker.0 00000100:00100000:1.0:1789607769.995437:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150157312:0@lo:400:kworker.0 00000100:00100000:0.0:1789607769.995601:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150157440:0@lo:400:kworker.0 00000100:00100000:0.0:1789607769.995619:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150157568:0@lo:400:kworker.0 00000020:01000004:1.0:1789607769.996038:0:23266:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789607769.996051:0:23266:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d78f05b19c0) 00000020:00000080:1.0:1789607769.996072:0:23266:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1789607769.996162:0:23266:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d77c4ba1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789607769.996165:0:23266:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d77c4ba1000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789607769.996168:0:23266:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d77c4ba1000 3 00010000:00080000:1.0:1789607769.997033:0:23266:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d77c48d4800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.125@tcp at head 00010000:00010000:1.0:1789607769.998761:0:23266:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789607769.999230:0:23266:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789607769.999269:0:23266:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789607769.999283:0:23266:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa26202d240fbf249 00000100:00080000:1.0:1789607769.999292:0:23266:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789607769.999303:0:23266:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d77c48d4800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607769.999336:0:23266:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cf7c6d80 x1876539150157824/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607769.999352:0:23266:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789607769.999379:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607769.999383:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789607769.999386:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607769.999388:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789607769.999392:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607769.999395:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789607769.999397:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607769.999400:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789607770.001114:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3467:1876539150157824:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789607770.001285:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789607770.001651:0:23266:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00010000:00080000:3.0:1789607770.001823:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78ff79f100 x1876539150157184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607770.001848:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607770.001896:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1789607770.001906:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789607770.001910:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789607770.001913:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c5715000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789607770.001920:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3467:1876539150157184:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1789607770.001947:0:23243:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789607770.001977:0:23243:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789607770.001996:0:23243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8200/0xa26202d240fbf21f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf226 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607770.002007:0:23243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8200/0xa26202d240fbf21f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf226 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789607770.002051:0:23243:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789607770.002054:0:23243:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789607770.002055:0:23243:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607770.002057:0:23243:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607770.002058:0:23243:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607770.002060:0:23243:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607770.002061:0:23243:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607770.002063:0:23243:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607770.002064:0:23243:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607770.002068:0:23243:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789607770.002070:0:23243:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607770.002072:0:23243:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789607770.002073:0:23243:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607770.002074:0:23243:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607770.002075:0:23243:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607770.002076:0:23243:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607770.002078:0:23243:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607770.002084:0:23243:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607770.002085:0:23243:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607770.002106:0:23243:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789607770.002119:0:23243:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150157952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789607770.002172:0:23243:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607770.002318:0:23243:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607770.002540:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150157952 00000100:00100000:1.0:1789607770.002548:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150157952 00000100:00100000:1.0:1789607770.002615:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789607770.002624:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:23243:x1876539150157952:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789607770.002659:0:21923:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789607770.002672:0:21923:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789607770.003610:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150157824 00000100:00100000:0.0:1789607770.003619:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150157824 00000100:00100000:0.0:1789607770.003653:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789607770.003661:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3467:x1876539150157824:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789607770.003688:0:21932:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:0.0:1789607770.003718:0:21932:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa26202d240fbf250 00000004:00100000:0.0:1789607770.003733:0:21932:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789607770.003767:0:21932:0:(import.c:65:import_set_state_nolock()) ffff8d77c5711800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607770.003835:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3467:x1876539150157824:12345-0@lo:38:llog_process_th.0 Request processed in 174us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607770.003842:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789607770.018132:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d78cf7c6d80 x1876539150157824/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607770.018147:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607770.018157:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1789607770.018166:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789607770.018171:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789607770.018174:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c48d4800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789607770.018181:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3467:1876539150157824:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1789607770.024825:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1789607770.092393:0:21923:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789607770.092414:0:21923:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789607770.092480:0:21946:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789607770.092485:0:21946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789607770.092507:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607770.092527:0:21946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbf1a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf19a expref: 21 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607770.092534:0:21946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf1af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf1a8 expref: 21 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607770.092558:0:21946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607770.092598:0:21946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf1af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbf1a8 expref: 21 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607770.092610:0:21946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf1af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbf1a8 expref: 21 pid: 21924 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607770.092624:0:21946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150158080:0@lo:104: 00000100:00100000:2.0:1789607770.092688:0:21946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607770.092744:0:21946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbf1a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbf19a expref: 21 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607770.092753:0:21946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbf1a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbf19a expref: 21 pid: 21924 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607770.092762:0:21946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150158208:0@lo:104: 00000100:00100000:2.0:1789607770.092785:0:21946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607770.094023:0:21946:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0f0dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607770.101588:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:23243:x1876539150157952:12345-0@lo:253:mount.lustre.0 Request processed in 98957us (99407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607770.101616:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789607770.101718:0:23243:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23243:1876539150157952:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789607770.101733:0:23243:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789607770.101736:0:23243:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607770.101738:0:23243:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789607770.101739:0:23243:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607770.101740:0:23243:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607770.101742:0:23243:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607770.101743:0:23243:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607770.101744:0:23243:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607770.101746:0:23243:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607770.101753:0:23243:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789607770.101769:0:23243:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789607770.102199:0:23243:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607770.102368:0:23243:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607770.102530:0:23243:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607770.102689:0:23243:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607770.102836:0:23243:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607770.103056:0:23243:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000100:00100000:3.0:1789607770.103405:0:21914:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789607770.103431:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150158080 00000100:00100000:3.0:1789607770.103439:0:21914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150158080 00000100:00100000:3.0:1789607770.103472:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150158208 00000100:00100000:3.0:1789607770.103475:0:21914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150158208 00000100:00100000:3.0:1789607770.103491:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607770.103499:0:21914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+4:21946:x1876539150158080:12345-0@lo:104: 00010000:00010000:3.0:1789607770.103518:0:21914:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf1af expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607770.103609:0:21914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607770.103616:0:21914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+4:21946:x1876539150158080:12345-0@lo:104: Request processed in 118us (10928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607770.103622:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607770.103648:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789607770.103655:0:21914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:21946:x1876539150158208:12345-0@lo:104: 00010000:00010000:3.0:1789607770.103664:0:21914:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf1a1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607770.103698:0:21914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789607770.103703:0:21914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:21946:x1876539150158208:12345-0@lo:104: Request processed in 50us (10917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607770.103709:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789607770.103797:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607770.103805:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf1af expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.103813:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607770.103817:0:21918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbf1af expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.103826:0:21918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbf1af expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607770.103845:0:21918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbf1af expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607770.103851:0:21918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607770.103920:0:21918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf1af expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.103926:0:21918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607770.103948:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf1af expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.103955:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8600/0xa26202d240fbf1a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf1af expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.103967:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607770.103971:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf1a1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.103988:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:1.0:1789607770.103991:0:21918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbf1a1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.103998:0:21918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbf1a1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607770.104005:0:21918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbf1a1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607770.104010:0:21918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607770.104025:0:21918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf1a1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104030:0:21918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607770.104046:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf1a1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104052:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9600/0xa26202d240fbf19a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf1a1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104065:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607770.104067:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607770.104070:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607770.104076:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607770.104089:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77c69b89-f077-4f20-ab40-68d85082562e:3471:1876539150158336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607770.104126:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607770.104173:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150158464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607770.104208:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607770.104244:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150158336 00000100:00100000:1.0:1789607770.104248:0:21915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150158336 00010000:00010000:1.0:1789607770.104268:0:21915:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf1af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf1a8 expref: 21 pid: 21924 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607770.104288:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150158464 00000100:00100000:1.0:1789607770.104291:0:21915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150158464 00010000:00010000:1.0:1789607770.104303:0:21915:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbf1a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf19a expref: 22 pid: 21924 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607770.104315:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607770.104321:0:21915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77c69b89-f077-4f20-ab40-68d85082562e+22:3471:x1876539150158336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607770.104332:0:21915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607770.104337:0:21915:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf1af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf1a8 expref: 22 pid: 21924 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104348:0:21915:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf1af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbf1a8 expref: 22 pid: 21924 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104362:0:21915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607770.104390:0:21915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77c69b89-f077-4f20-ab40-68d85082562e+22:3471:x1876539150158336:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607770.104395:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607770.104409:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607770.104415:0:21915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd139450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77c69b89-f077-4f20-ab40-68d85082562e+21:3468:x1876539150158464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607770.104421:0:21915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607770.104425:0:21915:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbf1a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf19a expref: 21 pid: 21924 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104444:0:21915:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbf1a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbf19a expref: 21 pid: 21924 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104455:0:21915:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104464:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789607770.104478:0:21915:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011993814s 00010000:00010000:1.0:1789607770.104483:0:21915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104491:0:21915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104498:0:21915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104505:0:21915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104510:0:21915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59de00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607770.104514:0:21915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104522:0:21915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104531:0:21915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104547:0:21915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607770.104575:0:21915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd139450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77c69b89-f077-4f20-ab40-68d85082562e+21:3468:x1876539150158464:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607770.104581:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607770.104637:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150158464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607770.104659:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77c69b89-f077-4f20-ab40-68d85082562e:3471:1876539150158336:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607770.104682:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59c000/0xa26202d240fbf1af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbf1a8 expref: 20 pid: 21924 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607770.104693:0:21946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150158080:0@lo:104: 00010000:00010000:1.0:1789607770.104703:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59d800/0xa26202d240fbf1a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbf19a expref: 19 pid: 21924 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607770.104710:0:21946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150158208:0@lo:104: 00010000:00010000:1.0:1789607770.104724:0:21946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104732:0:21946:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104738:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607770.104743:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59de00/0xa26202d240fbf257 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1789607770.105641:0:23243:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1789607770.161208:0:23243:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789607770.161219:0:23243:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789607770.161254:0:23243:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789607770.161320:0:23243:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789607770.161336:0:23243:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789607770.161364:0:23243:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789607771.046727:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789607771.618078:0:21927:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789607771.618086:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d77c610b000 from 13 10000000:01000000:2.0:1789607771.618092:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789607771.618138:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607771.618149:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607771.618161:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607771.618186:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150158592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607771.618250:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607771.618290:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d32ca540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607771.618312:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150158592 00000100:00100000:2.0:1789607771.618328:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150158592 00000100:00100000:2.0:1789607771.618376:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789607771.618399:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+19:21927:x1876539150158592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607771.618413:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607771.618427:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf25e expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607771.618450:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf25e expref: 20 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607771.618461:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf25e expref: 20 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607771.618470:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59d600, rc 0) 00000100:00100000:2.0:1789607771.618511:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+20:21927:x1876539150158592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607771.618518:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789607771.618562:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150158592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607771.618576:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf265 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607771.618585:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf265 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607771.618629:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150158720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789607771.618658:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607771.618680:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d32ca540 going to sleep for 11 seconds 00000100:00100000:0.0:1789607771.618914:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150158720 00000100:00100000:0.0:1789607771.618919:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150158720 00000100:00100000:0.0:1789607771.618945:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789607771.618952:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+20:21927:x1876539150158720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789607771.618967:0:21923:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789607771.618982:0:21923:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789607771.618986:0:21923:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789607771.619074:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+20:21927:x1876539150158720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607771.619082:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789607771.619221:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150158720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789607771.619281:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789607771.619293:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf265 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607771.619301:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf265 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607771.619319:0:21927:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789607771.619322:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78c2f72000 from 13 10000000:01000000:2.0:1789607771.619325:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789607771.619343:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607771.619350:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607771.619357:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607771.619370:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150158848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607771.619396:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607771.619423:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d32ca540 going to sleep for 11 seconds 00000100:00100000:0.0:1789607771.619519:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150158848 00000100:00100000:0.0:1789607771.619524:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150158848 00000100:00100000:0.0:1789607771.619550:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789607771.619557:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+20:21927:x1876539150158848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607771.619571:0:21923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607771.619583:0:21923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c3f65200/0xa26202d240fbf273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf26c expref: -99 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607771.619599:0:21923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c3f65200/0xa26202d240fbf273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf26c expref: 21 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607771.619607:0:21923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c3f65200/0xa26202d240fbf273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf26c expref: 21 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607771.619615:0:21923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c3f65200, rc 0) 00000100:00100000:0.0:1789607771.619645:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:21927:x1876539150158848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607771.619650:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789607771.619790:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150158848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607771.619801:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf273 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607771.619808:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf273 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607771.619844:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150158976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789607771.620160:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607771.620188:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d32ca540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607771.620231:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150158976 00000100:00100000:2.0:1789607771.620236:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150158976 00000100:00100000:2.0:1789607771.620266:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789607771.620272:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:21927:x1876539150158976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789607771.620285:0:21923:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789607771.620298:0:21923:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789607771.620301:0:21923:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1789607771.620826:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:21927:x1876539150158976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 552us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607771.620835:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789607771.624957:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150158976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789607771.625508:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789607771.625520:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf273 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607771.625534:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf273 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607772.068337:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607772.900610:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150159104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607772.900681:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607772.900798:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607772.900808:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150159232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607772.900846:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607772.901233:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150159104 00000100:00100000:1.0:1789607772.901241:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150159104 00000100:00100000:1.0:1789607772.901285:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150159232 00000100:00100000:1.0:1789607772.901289:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150159232 00000100:00100000:1.0:1789607772.901306:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607772.901314:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150159104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607772.901353:0:21935:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607772.901401:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150159104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607772.901407:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607772.901423:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607772.901428:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150159232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789607772.901445:0:21935:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789607772.901474:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150159232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607772.901479:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789607772.902175:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150159232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607772.902221:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150159104:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789607773.090444:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607774.116322:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607775.140398:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789607775.460998:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607775.461004:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607775.461007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607775.461010:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607775.461024:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607775.461027:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789607775.461029:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607775.461032:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789607775.461066:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150159744:0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.461126:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607775.461163:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789607775.461169:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150159360:0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.461195:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607775.461232:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150159872:0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.461256:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607775.461295:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150159488:0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.461316:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607775.461332:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150160000:0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.461353:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607775.461368:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789607775.461373:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150159616:0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.461390:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607775.461403:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150160128:0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.461420:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607775.461443:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150159744 00000100:00100000:2.0:1789607775.461449:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150159744 00000100:00100000:2.0:1789607775.461485:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150159488 00000100:00100000:2.0:1789607775.461488:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150159488 00000100:00100000:2.0:1789607775.461504:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789607775.461512:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150159744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.461566:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150159744:12345-0@lo:400:kworker.0 Request processed in 54us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607775.461572:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789607775.461588:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789607775.461594:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150159488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.461627:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150159488:12345-0@lo:400:kworker.0 Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607775.461633:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789607775.461650:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150159360 00000100:00100000:2.0:1789607775.461660:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150159360 00000100:00100000:2.0:1789607775.461682:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789607775.461687:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+21:3470:x1876539150159360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.461718:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+21:3470:x1876539150159360:12345-0@lo:400:kworker.0 Request processed in 31us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607775.461724:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789607775.461751:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150159872 00000100:00100000:2.0:1789607775.461755:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150159872 00000100:00100000:2.0:1789607775.461771:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150160000 00000100:00100000:2.0:1789607775.461773:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150160000 00000100:00100000:2.0:1789607775.461890:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150159616 00000100:00100000:2.0:1789607775.461894:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150159616 00000100:00100000:2.0:1789607775.461910:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150160128 00000100:00100000:2.0:1789607775.461912:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150160128 00000100:00100000:2.0:1789607775.461928:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607775.461934:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c624a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150159872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.461964:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c624a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150159872:12345-0@lo:400:kworker.0 Request processed in 30us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607775.461970:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607775.461982:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607775.461987:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c624b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150160000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.462012:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c624b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150160000:12345-0@lo:400:kworker.0 Request processed in 25us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607775.462017:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607775.462028:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789607775.462033:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150159616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.462056:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150159616:12345-0@lo:400:kworker.0 Request processed in 24us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607775.462068:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789607775.462081:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607775.462087:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c624a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150160128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.462115:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c624a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150160128:12345-0@lo:400:kworker.0 Request processed in 29us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607775.462120:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789607775.462167:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78c61fea00 x1876539150159616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607775.462181:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150159616:0@lo:400:kworker.0 00010000:00080000:2.0:1789607775.462190:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78c6249500 x1876539150160128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607775.462198:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150160128:0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.462205:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150159488:0@lo:400:kworker.0 00010000:00080000:2.0:1789607775.462212:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78c61fdc00 x1876539150160000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607775.462218:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150160000:0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.462248:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150159360:0@lo:400:kworker.0 00010000:00080000:2.0:1789607775.462257:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78c61fd180 x1876539150159872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607775.462264:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150159872:0@lo:400:kworker.0 00000100:00100000:2.0:1789607775.462272:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150159744:0@lo:400:kworker.0 00000100:00080000:2.0:1789607775.462622:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607775.462626:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789607775.590652:0:21964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789607776.162360:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789607776.646433:0:23613:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789607777.186010:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607778.019326:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607778.019349:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150160256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607778.019417:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607778.019540:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150160256 00000100:00100000:2.0:1789607778.019547:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150160256 00000100:00100000:2.0:1789607778.019595:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789607778.019603:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150160256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789607778.019636:0:21935:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789607778.019677:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150160256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607778.019683:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789607778.019787:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150160384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607778.019822:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607778.019880:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150160256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789607778.019948:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150160384 00000100:00100000:2.0:1789607778.020036:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150160384 00000100:00100000:2.0:1789607778.020066:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607778.020072:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150160384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789607778.020091:0:21936:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607778.020125:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150160384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607778.020130:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607778.020154:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150160384:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789607778.213821:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607779.242554:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789607780.004422:0:22590:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789607780.258339:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789607780.579457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607780.579466:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607780.579469:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607780.579473:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607780.579503:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607780.579507:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607780.579510:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607780.579514:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789607780.579565:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150160512:0@lo:400:kworker.0 00000100:00100000:0.0:1789607780.579655:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607780.579726:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150161024:0@lo:400:kworker.0 00000100:00100000:1.0:1789607780.579802:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150160640:0@lo:400:kworker.0 00000100:00100000:3.0:1789607780.579949:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150160768:0@lo:400:kworker.0 00000100:00100000:1.0:1789607780.580995:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607780.581047:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150161152:0@lo:400:kworker.0 00000100:00100000:1.0:1789607780.581103:0:22574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150160640 00000100:00100000:1.0:1789607780.581125:0:22574:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150160640 00000100:00100000:1.0:1789607780.581195:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789607780.581208:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150160640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607780.581284:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150160640:12345-0@lo:400:kworker.0 Request processed in 78us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607780.581292:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789607780.581359:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150160512 00000100:00100000:3.0:1789607780.581365:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150160512 00000100:00100000:3.0:1789607780.581414:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789607780.581421:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:3468:x1876539150160512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607780.581462:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:3468:x1876539150160512:12345-0@lo:400:kworker.0 Request processed in 42us (1807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607780.581469:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789607780.581501:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150160896:0@lo:400:kworker.0 00000100:00100000:0.0:1789607780.581619:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607780.581664:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150161024 00000100:00100000:0.0:1789607780.581668:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150161024 00000100:00100000:0.0:1789607780.581700:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789607780.581707:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150161024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607780.581736:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3468:x1876539150161024:12345-0@lo:400:kworker.0 Request processed in 31us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607780.581742:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789607780.582727:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd117b80 x1876539150161024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607780.583003:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607780.583068:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150161280:0@lo:400:kworker.0 00000100:00100000:2.0:1789607780.583125:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150160768 00000100:00100000:0.0:1789607780.583133:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607780.583134:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150160768 00000100:00100000:2.0:1789607780.583178:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150161280 00000100:00100000:2.0:1789607780.583181:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150161280 00000100:00100000:0.0:1789607780.583189:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607780.583202:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150160768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607780.583216:0:21930:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789607780.583227:0:21930:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1789607780.583247:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607780.583261:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150160768:12345-0@lo:400:kworker.0 Request processed in 62us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607780.583269:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607780.583290:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607780.583296:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150161280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607780.583322:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150161280:12345-0@lo:400:kworker.0 Request processed in 27us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607780.583328:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789607780.583359:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd115880 x1876539150160768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607780.583374:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150160768:0@lo:400:kworker.0 00010000:00080000:0.0:1789607780.583412:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd116300 x1876539150161280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607780.583421:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150161280:0@lo:400:kworker.0 00000100:00100000:0.0:1789607780.583463:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607780.583500:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150160640:0@lo:400:kworker.0 00000100:00100000:0.0:1789607780.583518:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150161152 00000100:00100000:0.0:1789607780.583521:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150161152 00000100:00100000:0.0:1789607780.583554:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607780.583561:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150161152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607780.583596:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150161152:12345-0@lo:400:kworker.0 Request processed in 36us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607780.583603:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789607780.583618:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789607780.583642:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd114380 x1876539150161152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607780.583652:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150161152:0@lo:400:kworker.0 00000100:00100000:1.0:1789607780.583922:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3468:1876539150161024:0@lo:400:kworker.0 00000100:00100000:1.0:1789607780.583952:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150160512:0@lo:400:kworker.0 00000100:00100000:3.0:1789607780.584305:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607780.584352:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150160896 00000100:00100000:3.0:1789607780.584357:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150160896 00000100:00100000:3.0:1789607780.584392:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789607780.584400:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150160896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607780.584444:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150160896:12345-0@lo:400:kworker.0 Request processed in 46us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607780.584464:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789607780.584495:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150160896:0@lo:400:kworker.0 00010000:00010000:0.0:1789607781.286789:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607782.243166:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607767/real 1789607767] req@ffff8d78c61ffb80 x1876539150153472/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607782 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607782.243211:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78c61ffb80 x1876539150153472/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607782 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607782.243223:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607767/real 1789607767] req@ffff8d78c61ff100 x1876539150153600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607782 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607782.243235:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78c61ff100 x1876539150153600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607782 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789607782.243262:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78ef1f0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607782.243293:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789607782.243298:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150153472:0@lo:8:kworker.0 00000100:00080000:3.0:1789607782.243304:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f06c2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607782.243311:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789607782.243314:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150153600:0@lo:8:kworker.0 00000100:00080000:0.0:1789607782.245734:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607782.245742:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607782.245753:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607782.245757:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607782.245786:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607782.245791:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789607782.245804:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d78ef1f0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607782.245814:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 672 00000100:00080000:0.0:1789607782.245822:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789607782.245838:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d78ef1f0800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607782.245888:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd116680 x1876539150161920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607782.245908:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607782.245911:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789607782.245913:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d78f06c2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607782.245917:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 672 00000100:00080000:0.0:1789607782.245919:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789607782.245924:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d78f06c2800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607782.245938:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd115f80 x1876539150162048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607782.245995:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150161792:0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.246091:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.246141:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789607782.246147:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150161408:0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.246184:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.246224:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150162176:0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.246254:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.246285:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150161536:0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.246311:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.246329:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150162304:0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.246361:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.246379:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789607782.246384:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150161664:0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.246403:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.246418:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150162432:0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.246435:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.246466:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150161920:0@lo:8:kworker.0 00000100:00100000:0.0:1789607782.246490:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.246521:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150162048:0@lo:8:kworker.0 00000100:00100000:0.0:1789607782.246541:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.246578:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150161792 00000100:00100000:0.0:1789607782.246589:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150161792 00000100:00100000:0.0:1789607782.246645:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150161536 00000100:00100000:0.0:1789607782.246647:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150161536 00000100:00100000:0.0:1789607782.246663:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789607782.246671:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150161792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.246729:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150161792:12345-0@lo:400:kworker.0 Request processed in 57us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607782.246736:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789607782.246754:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789607782.246760:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150161536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.246802:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150161536:12345-0@lo:400:kworker.0 Request processed in 42us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607782.246809:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789607782.246828:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150162176 00000100:00100000:0.0:1789607782.246832:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150162176 00000100:00100000:0.0:1789607782.246884:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150162304 00000100:00100000:0.0:1789607782.246889:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150162304 00000100:00100000:0.0:1789607782.246914:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150161664 00000100:00100000:0.0:1789607782.246917:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150161664 00000100:00100000:0.0:1789607782.246929:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150162432 00000100:00100000:0.0:1789607782.246932:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150162432 00000100:00100000:0.0:1789607782.246947:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789607782.246951:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150162176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.246986:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150162176:12345-0@lo:400:kworker.0 Request processed in 34us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607782.246991:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789607782.247001:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789607782.247006:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150162304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.247029:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150162304:12345-0@lo:400:kworker.0 Request processed in 23us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607782.247034:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789607782.247043:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789607782.247048:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150161664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.247069:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150161664:12345-0@lo:400:kworker.0 Request processed in 21us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607782.247074:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789607782.247081:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789607782.247087:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150162432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.247109:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150162432:12345-0@lo:400:kworker.0 Request processed in 22us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607782.247114:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789607782.247147:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607782.247161:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789607782.247195:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd115880 x1876539150161664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607782.247210:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150161664:0@lo:400:kworker.0 00010000:00080000:0.0:1789607782.247222:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd117b80 x1876539150162432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607782.247230:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150162432:0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.247239:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150161536:0@lo:400:kworker.0 00010000:00080000:0.0:1789607782.247248:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd115c00 x1876539150162304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607782.247256:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150162304:0@lo:400:kworker.0 00010000:00080000:0.0:1789607782.247293:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd114000 x1876539150162176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607782.247301:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150162176:0@lo:400:kworker.0 00000100:00100000:0.0:1789607782.247311:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150161792:0@lo:400:kworker.0 00000100:00100000:2.0:1789607782.247611:0:23244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150161920 00000100:00100000:2.0:1789607782.247617:0:23244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150161920 00000100:00100000:2.0:1789607782.247658:0:23244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150162048 00000100:00100000:2.0:1789607782.247661:0:23244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150162048 00000100:00100000:2.0:1789607782.247672:0:23244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607782.247677:0:23244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3467:x1876539150161920:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789607782.247710:0:23244:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:2.0:1789607782.247755:0:23244:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbf27a 00002000:00100000:2.0:1789607782.247781:0:23244:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d77c5f00000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789607782.247786:0:23244:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1789607782.247790:0:23244:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789607782.248250:0:23244:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789607782.248285:0:23244:0:(import.c:65:import_set_state_nolock()) ffff8d77c5f06800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607782.248377:0:23244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3467:x1876539150161920:12345-0@lo:8:kworker.0 Request processed in 698us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607782.248386:0:23244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607782.248407:0:23244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607782.248412:0:23244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3467:x1876539150162048:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789607782.248428:0:23244:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789607782.250982:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150161408 00000100:00100000:3.0:1789607782.251005:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150161408 00000100:00100000:3.0:1789607782.251094:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789607782.251105:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+21:3470:x1876539150161408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607782.251215:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+21:3470:x1876539150161408:12345-0@lo:400:kworker.0 Request processed in 113us (5029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607782.251223:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789607782.252987:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150161408:0@lo:400:kworker.0 00010000:00080000:3.0:1789607782.257765:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd116680 x1876539150161920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607782.257796:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607782.257811:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789607782.257823:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789607782.257831:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789607782.257835:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78ef1f0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789607782.257886:0:3467:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789607782.257894:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150161920:0@lo:8:kworker.0 00000004:00080000:3.0:1789607782.257937:0:22575:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789607782.258454:0:22575:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 687215591084ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789607782.258815:0:22577:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789607782.258850:0:22577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22577:1876539150162688:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789607782.258970:0:22577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.259008:0:22577:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607782.259051:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607782.259064:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150162560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607782.259110:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.259151:0:23245:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789607782.259158:0:23245:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789607782.259573:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150162560 00000100:00100000:3.0:1789607782.259584:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150162560 00000100:00100000:3.0:1789607782.260594:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607782.260614:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3471:x1876539150162560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607782.260734:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607782.260920:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3471:x1876539150162560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 315us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607782.260927:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789607782.263726:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607782.263847:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f0701c00 x1876539150162560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607782.263892:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150162560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607782.265656:0:23245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150162688 00000100:00100000:0.0:1789607782.265670:0:23245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150162688 00000100:00100000:3.0:1789607782.267934:0:23852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607782.267954:0:23852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:22577:x1876539150162688:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:3.0:1789607782.281616:0:23852:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789607782.281627:0:23852:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1789607782.281750:0:23852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:22577:x1876539150162688:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13796us (22774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607782.281763:0:23852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789607782.284885:0:22577:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f0703b80 x1876539150162688/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789607798 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607782.284912:0:22577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22577:1876539150162688:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789607782.284932:0:22577:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1789607782.284991:0:22577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22577:1876539150162816:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789607782.285065:0:22577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.285101:0:22577:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607782.285142:0:23245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150162816 00000100:00100000:0.0:1789607782.285150:0:23245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150162816 00000100:00100000:0.0:1789607782.285215:0:23245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607782.285225:0:23245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:22577:x1876539150162816:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789607782.285262:0:23245:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1789607782.285308:0:23245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:22577:x1876539150162816:12345-0@lo:5:osp-pre-0-1.0 Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607782.285315:0:23245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789607782.285351:0:22577:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f0703b80 x1876539150162816/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607798 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607782.285376:0:22577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22577:1876539150162816:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789607782.285387:0:22577:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1789607782.285414:0:22577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22577:1876539150162944:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789607782.285438:0:22577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.285460:0:22577:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607782.286130:0:23852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150162944 00000100:00100000:3.0:1789607782.286149:0:23852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150162944 00000100:00100000:3.0:1789607782.286190:0:23852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789607782.286198:0:23852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:22577:x1876539150162944:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789607782.286244:0:23852:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1789607782.295889:0:23244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3467:x1876539150162048:12345-0@lo:8:kworker.0 Request processed in 47445us (49315us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789607782.295908:0:23244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789607782.296017:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f06c2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607782.296025:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789607782.296030:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150162048:0@lo:8:kworker.0 00010000:00010000:0.0:1789607782.311094:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607782.316186:0:23852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:22577:x1876539150162944:12345-0@lo:5:osp-pre-0-1.0 Request processed in 29974us (30731us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789607782.316205:0:23852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789607782.316277:0:22577:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f0703b80 x1876539150162944/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607798 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607782.316298:0:22577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22577:1876539150162944:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789607782.316318:0:22577:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1789607782.316375:0:22577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:22577:1876539150163072:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789607782.316422:0:22577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607782.316450:0:22577:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452780 going to sleep for 11 seconds 00000100:00100000:3.0:1789607782.316491:0:21942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150163072 00000100:00100000:3.0:1789607782.316499:0:21942:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150163072 00000100:00100000:3.0:1789607782.316547:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607782.316556:0:21942:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22577:x1876539150163072:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789607782.316615:0:21942:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22577:x1876539150163072:12345-0@lo:900:osp-pre-0-1.0 Request processed in 60us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607782.316621:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789607782.316646:0:22577:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d790133ca80 x1876539150163072/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789607798 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607782.316656:0:22577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:22577:1876539150163072:0@lo:900:osp-pre-0-1.0 00000004:00080000:0.0:1789607782.345663:0:7270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789607783.143707:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150163200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607783.143823:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607783.143940:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150163200 00000100:00100000:3.0:1789607783.143950:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150163200 00000100:00100000:3.0:1789607783.144008:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789607783.144029:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150163200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607783.144081:0:21936:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607783.144135:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150163200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607783.144142:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789607783.144202:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150163200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607783.149079:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607783.149109:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150163328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607783.149209:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607783.149343:0:22574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150163328 00000100:00100000:1.0:1789607783.149354:0:22574:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150163328 00000100:00100000:1.0:1789607783.149415:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789607783.149425:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150163328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789607783.149481:0:22574:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789607783.149534:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150163328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607783.149542:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789607783.149599:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150163328:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789607783.331186:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607784.355075:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789607784.666611:0:23965:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789607784.666619:0:23965:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789607784.666790:0:23965:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d77c52a0000 00000020:01000004:3.0:1789607784.666812:0:23965:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789607784.666835:0:23965:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789607784.666855:0:23965:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d77c4ce0000) 00000020:00000080:3.0:1789607784.666909:0:23965:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789607784.702249:0:23965:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789607784.702517:0:23965:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789607784.703369:0:23965:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789607784.711253:0:23965:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789607784.712014:0:23965:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1789607784.713108:0:23965:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 551: rc = 0 00100000:10000000:0.0:1789607784.713214:0:23965:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 551: rc = 0 00100000:10000000:0.0:1789607784.713330:0:23965:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 551: rc = 0 00100000:10000000:0.0:1789607784.714776:0:23965:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 689: rc = 0 00100000:10000000:0.0:1789607784.716919:0:23965:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 689: rc = 0 00100000:10000000:0.0:1789607784.717362:0:23965:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 689: rc = 0 00100000:10000000:0.0:1789607784.717649:0:23965:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 689: rc = 0 00100000:10000000:0.0:1789607784.718004:0:23965:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 689: rc = 0 00100000:10000000:0.0:1789607784.718274:0:23965:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 689: rc = 0 00000020:00000080:0.0:1789607784.719026:0:23965:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789607784.719046:0:23965:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789607784.719061:0:23965:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa26202d240fbf288 00000020:01000004:0.0:1789607784.719072:0:23965:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789607784.719101:0:23965:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.125@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789607784.719105:0:23965:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789607784.719113:0:23965:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789607784.719140:0:23965:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789607784.719158:0:23965:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789607784.741987:0:23965:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789607784.743022:0:23965:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.125@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789607784.743030:0:23965:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789607784.745839:0:23965:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789607784.745843:0:23965:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607784.745845:0:23965:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607784.745847:0:23965:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607784.745850:0:23965:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607784.745852:0:23965:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607784.745854:0:23965:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607784.745855:0:23965:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789607784.745903:0:23965:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789607784.745908:0:23965:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789607784.745909:0:23965:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789607784.745910:0:23965:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607784.745912:0:23965:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607784.745913:0:23965:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607784.745914:0:23965:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607784.745915:0:23965:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607784.745916:0:23965:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607784.745917:0:23965:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789607784.745964:0:23965:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789607784.745995:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150163456:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789607784.746127:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.746197:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607784.746407:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150163456 00000100:00100000:1.0:1789607784.746418:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150163456 00000100:00100000:1.0:1789607784.746483:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789607784.746494:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+21:23965:x1876539150163456:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789607784.746545:0:21924:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789607784.746549:0:21924:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789607784.746555:0:21924:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789607784.756118:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+21:23965:x1876539150163456:12345-0@lo:253:mount.lustre.0 Request processed in 9613us (9977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607784.756136:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789607784.756157:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150163456:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789607784.756182:0:23965:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789607784.756187:0:23965:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789607784.756188:0:23965:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789607784.756190:0:23965:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607784.756191:0:23965:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607784.756192:0:23965:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607784.756194:0:23965:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607784.756196:0:23965:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607784.756198:0:23965:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607784.756200:0:23965:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789607784.756227:0:23965:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d77c52a0000 from lustre-OST0001 10000000:01000000:0.0:1789607784.756269:0:23965:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789607784.756273:0:23965:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789607784.756286:0:23965:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d78c5b919c0 local copy 00010000:00010000:0.0:1789607784.756301:0:23965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefa9 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607784.756613:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150163584:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607784.756664:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.756710:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f313c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607784.756838:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150163584 00000100:00100000:3.0:1789607784.756845:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150163584 00000100:00100000:3.0:1789607784.756918:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789607784.756929:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:23965:x1876539150163584:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607784.757530:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:23965:x1876539150163584:12345-0@lo:501:mount.lustre.0 Request processed in 601us (864us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789607784.757542:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789607784.757563:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150163584:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789607784.757585:0:23965:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789607784.757850:0:23965:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789607784.757880:0:23965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefa9 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607784.757892:0:23965:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78c0031800/0xa26202d240fbefa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbefa9 expref: -99 pid: 21912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607784.757921:0:23965:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d77c52a0000 10000000:01000000:1.0:1789607784.757927:0:23965:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789607784.757933:0:23965:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789607784.757936:0:23965:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789607784.757941:0:23965:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789607784.757944:0:23965:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789607784.757979:0:23965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf28f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607784.757989:0:23965:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf28f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607784.758002:0:23965:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf28f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607784.758022:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150163712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789607784.758134:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607784.758172:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d8ad8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607784.758497:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150163712 00000100:00100000:3.0:1789607784.758504:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150163712 00000100:00100000:3.0:1789607784.758551:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789607784.758560:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+21:23965:x1876539150163712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607784.758575:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607784.758591:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbf296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf28f expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.758618:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbf296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf28f expref: 22 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.758629:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7900ef8400/0xa26202d240fbf296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf28f expref: 22 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.758639:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8400, rc 0) 00000100:00100000:3.0:1789607784.758687:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+22:23965:x1876539150163712:12345-0@lo:101:mount.lustre.0 Request processed in 129us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607784.758694:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789607784.758786:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150163712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607784.758816:0:23965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf28f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf296 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607784.758828:0:23965:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf28f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf296 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789607784.762515:0:23965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1789607784.764784:0:23965:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607784.766317:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789607784.767021:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1789607784.767101:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1789607784.767236:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1789607784.767299:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1789607784.767374:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1789607784.768081:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1789607784.768163:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1789607784.768277:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1789607784.768787:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1789607784.768797:0:23965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1789607784.769176:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150163840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607784.769543:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607784.769662:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e084d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607784.769815:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150163840 00000100:00100000:3.0:1789607784.769826:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150163840 00000100:00100000:3.0:1789607784.770159:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789607784.770173:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+22:23965:x1876539150163840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607784.770764:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+22:23965:x1876539150163840:12345-0@lo:501:mount.lustre.0 Request processed in 594us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607784.770775:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789607784.770913:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150163840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607784.770977:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150163968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607784.771043:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607784.774201:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150163968 00000100:00100000:2.0:1789607784.774224:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150163968 00000100:00100000:2.0:1789607784.774303:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789607784.774316:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+22:23965:x1876539150163968:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607784.775847:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+22:23965:x1876539150163968:12345-0@lo:503:mount.lustre.0 Request processed in 1521us (4791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607784.775895:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789607784.776363:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607784.776404:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150163968:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789607784.783074:0:23965:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789607784.784700:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607784.784841:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607784.784921:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607784.786058:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150164096 00000100:00100000:3.0:1789607784.786076:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150164096 00000100:00100000:3.0:1789607784.786171:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789607784.786183:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+22:23965:x1876539150164096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607784.786994:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+22:23965:x1876539150164096:12345-0@lo:502:mount.lustre.0 Request processed in 809us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607784.787004:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789607784.787923:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789607784.788319:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789607784.788528:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789607784.788569:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789607784.788616:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789607784.791089:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789607784.791168:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789607784.791259:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789607784.791302:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789607784.792099:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1789607784.792175:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607784.792283:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607784.792353:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7900c56000 going to sleep for 11 seconds 00000100:00100000:0.0:1789607784.793541:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150164224 00000100:00100000:0.0:1789607784.793559:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150164224 00000100:00100000:0.0:1789607784.793651:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789607784.793662:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+22:23965:x1876539150164224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607784.794067:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+22:23965:x1876539150164224:12345-0@lo:502:mount.lustre.0 Request processed in 405us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607784.794076:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789607784.794375:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789607784.794532:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1789607784.794552:0:23965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789607784.798828:0:23966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789607784.798846:0:23966:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789607784.798855:0:23966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607784.798858:0:23966:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789607784.798890:0:23966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607784.798938:0:23966:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d77c5134d40) 00000020:00000080:2.0:1789607784.798986:0:23966:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789607784.798995:0:23966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789607784.799081:0:23966:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d77c52a0000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789607784.799092:0:23966:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789607784.799100:0:23966:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa26202d240fbf2a4 00010000:00010000:2.0:1789607784.807842:0:23966:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789607784.810097:0:23966:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:2.0:1789607784.813666:0:23966:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1789607784.815577:0:23966:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789607784.815594:0:23966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607784.815602:0:23966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607784.815605:0:23966:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789607784.815610:0:23966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607784.815615:0:23966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607784.815617:0:23966:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789607784.815620:0:23966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789607784.815622:0:23966:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789607784.815625:0:23966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607784.815627:0:23966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607784.815639:0:23966:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789607784.815643:0:23966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607784.815645:0:23966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607784.815647:0:23966:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789607784.815651:0:23966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789607784.815947:0:23966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607784.815952:0:23966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607784.815954:0:23966:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789607784.815958:0:23966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1789607784.822067:0:23965:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789607784.822129:0:23965:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789607784.822296:0:23965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf28f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf296 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.822313:0:23965:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76800/0xa26202d240fbf28f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf296 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607784.822324:0:23965:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d77c52a0000 from 1 10000000:01000000:3.0:1789607784.822327:0:23965:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607784.822384:0:23965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.822394:0:23965:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.822408:0:23965:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607784.822443:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789607784.823339:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607784.823402:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb1600 going to sleep for 11 seconds 00000100:00100000:1.0:1789607784.823852:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150164352 00000100:00100000:1.0:1789607784.823882:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150164352 00000100:00100000:1.0:1789607784.823947:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789607784.823959:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+22:23965:x1876539150164352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607784.823979:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607784.823999:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fcf77400/0xa26202d240fbf2b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf2ab expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607784.824035:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fcf77400/0xa26202d240fbf2b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf2ab expref: 23 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607784.824049:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fcf77400/0xa26202d240fbf2b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf2ab expref: 23 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607784.824059:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf77400, rc 0) 00000100:00100000:1.0:1789607784.824122:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+23:23965:x1876539150164352:12345-0@lo:101:mount.lustre.0 Request processed in 164us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607784.824129:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789607784.824444:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607784.824474:0:23965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf2b2 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.824503:0:23965:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf2b2 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607784.825401:0:23965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1789607784.828704:0:23965:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607784.830087:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789607784.830153:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789607784.830205:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789607784.830244:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789607784.830277:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789607784.830326:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789607784.830386:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789607784.830421:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1789607784.831414:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1789607784.831500:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1789607784.831538:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1789607784.831659:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1789607784.831669:0:23965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1789607784.831825:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607784.831960:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607784.832016:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3fb1600 going to sleep for 11 seconds 00000100:00100000:1.0:1789607784.832258:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150164480 00000100:00100000:1.0:1789607784.832272:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150164480 00000100:00100000:1.0:1789607784.832328:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789607784.832340:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+23:23965:x1876539150164480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607784.832707:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+23:23965:x1876539150164480:12345-0@lo:501:mount.lustre.0 Request processed in 368us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607784.832716:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789607784.832934:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607784.832985:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607784.833037:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.833070:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e9f313c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607784.833138:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150164608 00000100:00100000:3.0:1789607784.833143:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150164608 00000100:00100000:3.0:1789607784.833181:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789607784.833189:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+23:23965:x1876539150164608:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607784.833361:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+23:23965:x1876539150164608:12345-0@lo:503:mount.lustre.0 Request processed in 172us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607784.833368:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789607784.833475:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164608:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789607784.834180:0:23965:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607784.834272:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607784.834337:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.834371:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607784.834904:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150164736 00000100:00100000:3.0:1789607784.834915:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150164736 00000100:00100000:3.0:1789607784.834965:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789607784.834975:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+23:23965:x1876539150164736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607784.835233:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+23:23965:x1876539150164736:12345-0@lo:502:mount.lustre.0 Request processed in 258us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607784.835241:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789607784.835535:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164736:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607784.836146:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1789607784.836216:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1789607784.836268:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1789607784.836304:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1789607784.836340:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1789607784.836390:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1789607784.836428:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1789607784.836993:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1789607784.837069:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1789607784.837110:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1789607784.837141:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1789607784.837203:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164864:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607784.837302:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.837352:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607784.837511:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150164864 00000100:00100000:1.0:1789607784.837521:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150164864 00000100:00100000:1.0:1789607784.837584:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789607784.837595:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+23:23965:x1876539150164864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607784.837903:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+23:23965:x1876539150164864:12345-0@lo:502:mount.lustre.0 Request processed in 309us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607784.837912:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789607784.838172:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789607784.838305:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1789607784.838321:0:23965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789607784.839683:0:23970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607784.839696:0:23970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607784.839699:0:23970:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789607784.839708:0:23970:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d77c52a0000 00000020:00000080:1.0:1789607784.839710:0:23970:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607784.839719:0:23970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607784.839722:0:23970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607784.839725:0:23970:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789607784.839727:0:23970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607784.839730:0:23970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607784.839731:0:23970:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789607784.839734:0:23970:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d77c52a0000 00000020:00000080:1.0:1789607784.839736:0:23970:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607784.839807:0:23970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607784.839810:0:23970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607784.839812:0:23970:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789607784.839815:0:23970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607784.839818:0:23970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607784.839819:0:23970:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789607784.839823:0:23970:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d77c52a0000 00000020:00000080:1.0:1789607784.839835:0:23970:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607784.839856:0:23970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607784.839893:0:23970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607784.839895:0:23970:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789607784.839898:0:23970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607784.839901:0:23970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607784.839903:0:23970:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789607784.839907:0:23970:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d77c52a0000 00000020:00000080:1.0:1789607784.839909:0:23970:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789607784.839949:0:23970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607784.839952:0:23970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607784.839954:0:23970:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789607784.839958:0:23970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1789607784.840234:0:23965:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789607784.840275:0:23965:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607784.840302:0:23965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf2b2 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.840329:0:23965:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf2b2 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607784.840387:0:23965:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789607784.840390:0:23965:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d77c52a0000 10000000:01000000:2.0:1789607784.840394:0:23965:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d77c52a0000 10000000:01000000:2.0:1789607784.840399:0:23965:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789607784.840405:0:23965:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d77c52a0000 from 1 10000000:01000000:2.0:1789607784.840408:0:23965:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789607784.840561:0:23965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbf2b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.840571:0:23965:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbf2b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.840585:0:23965:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbf2b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607784.840621:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607784.840718:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607784.840781:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2f36600 going to sleep for 11 seconds 00000100:00100000:1.0:1789607784.840913:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150164992 00000100:00100000:1.0:1789607784.840922:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150164992 00000100:00100000:1.0:1789607784.840982:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789607784.840994:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+23:23965:x1876539150164992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607784.841011:0:21925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607784.841028:0:21925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fcf76c00/0xa26202d240fbf2c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf2b9 expref: -99 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607784.841059:0:21925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fcf76c00/0xa26202d240fbf2c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf2b9 expref: 24 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607784.841071:0:21925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fcf76c00/0xa26202d240fbf2c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf2b9 expref: 24 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607784.841081:0:21925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fcf76c00, rc 0) 00000100:00100000:1.0:1789607784.841133:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+24:23965:x1876539150164992:12345-0@lo:101:mount.lustre.0 Request processed in 142us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607784.841140:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789607784.841256:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150164992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607784.841272:0:23965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbf2b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf2c0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.841283:0:23965:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbf2b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf2c0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607784.842271:0:23965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1789607784.847291:0:23965:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607784.852092:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789607784.852180:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1789607784.852247:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1789607784.852302:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1789607784.852345:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1789607784.852404:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1789607784.852443:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1789607784.859152:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1789607784.859279:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789607784.859319:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1789607784.859356:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1789607784.859408:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1789607784.859444:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1789607784.859552:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1789607784.859601:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1789607784.859714:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1789607784.859765:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1789607784.859824:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1789607784.859928:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1789607784.859963:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1789607784.860015:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1789607784.860051:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1789607784.860085:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1789607784.860131:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1789607784.860164:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1789607784.860193:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1789607784.860247:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1789607784.860284:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1789607784.860319:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1789607784.860385:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1789607784.860424:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1789607784.862350:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1789607784.864694:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1789607784.865699:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1789607784.866400:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1789607784.866540:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1789607784.866578:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1789607784.866609:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1789607784.866725:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1789607784.866773:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1789607784.866805:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1789607784.866835:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1789607784.867809:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1789607784.872543:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1789607784.872701:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1789607784.872814:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1789607784.872857:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1789607784.872919:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1789607784.873042:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1789607784.873111:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1789607784.873187:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1789607784.873196:0:23965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1789607784.873378:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150165120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607784.873482:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.874581:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789607784.874769:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150165120 00000100:00100000:3.0:1789607784.874782:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150165120 00000100:00100000:3.0:1789607784.874878:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789607784.874891:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+24:23965:x1876539150165120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607784.875259:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+24:23965:x1876539150165120:12345-0@lo:501:mount.lustre.0 Request processed in 369us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607784.875267:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789607784.875542:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150165120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607784.875608:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150165248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607784.876545:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.876587:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789607784.876744:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150165248 00000100:00100000:3.0:1789607784.876763:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150165248 00000100:00100000:3.0:1789607784.876811:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789607784.876821:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+24:23965:x1876539150165248:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607784.877058:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+24:23965:x1876539150165248:12345-0@lo:503:mount.lustre.0 Request processed in 237us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607784.877067:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789607784.877258:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150165248:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789607784.878566:0:23965:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607784.879822:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150165376:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607784.879941:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.879990:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789607784.881203:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150165376 00000100:00100000:3.0:1789607784.881220:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150165376 00000100:00100000:3.0:1789607784.881300:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789607784.881312:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+24:23965:x1876539150165376:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607784.881850:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+24:23965:x1876539150165376:12345-0@lo:502:mount.lustre.0 Request processed in 537us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607784.881903:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789607784.882266:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150165376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607784.884022:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789607784.884151:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1789607784.884190:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1789607784.884242:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1789607784.884282:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1789607784.884332:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1789607784.884372:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1789607784.884408:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1789607784.886738:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789607784.886907:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1789607784.886946:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1789607784.887045:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1789607784.887082:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1789607784.887115:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1789607784.887162:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1789607784.887197:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1789607784.887233:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1789607784.887287:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1789607784.887326:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1789607784.887362:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1789607784.887418:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1789607784.887455:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1789607784.887488:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1789607784.887533:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1789607784.887583:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1789607784.887616:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1789607784.889931:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1789607784.890034:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1789607784.890074:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1789607784.890129:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1789607784.890165:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1789607784.890197:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1789607784.890233:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1789607784.890285:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1789607784.890323:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1789607784.890376:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1789607784.890414:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1789607784.894516:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1789607784.895054:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1789607784.895103:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1789607784.895137:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1789607784.895173:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1789607784.895227:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1789607784.895280:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1789607784.895311:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1789607784.895358:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1789607784.895392:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1789607784.895422:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1789607784.895780:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150165504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607784.896373:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.896919:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150165504 00000100:00100000:0.0:1789607784.896933:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150165504 00000100:00100000:0.0:1789607784.897009:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789607784.897021:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+24:23965:x1876539150165504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607784.897358:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+24:23965:x1876539150165504:12345-0@lo:502:mount.lustre.0 Request processed in 338us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607784.897375:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789607784.898264:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789607784.898312:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150165504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607784.899359:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789607784.900730:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789607784.900834:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150165632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607784.900972:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.901022:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789607784.901605:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150165632 00000100:00100000:2.0:1789607784.901618:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150165632 00000100:00100000:2.0:1789607784.901702:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789607784.901713:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+24:23965:x1876539150165632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607784.902045:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+24:23965:x1876539150165632:12345-0@lo:502:mount.lustre.0 Request processed in 333us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607784.902055:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789607784.902607:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150165632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607784.905057:0:23965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1789607784.905093:0:23965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789607784.908001:0:23975:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789607784.908028:0:23975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d77c4553380) 00000020:00000080:1.0:1789607784.908063:0:23975:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789607784.908159:0:23975:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d77c52a0000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789607784.908164:0:23975:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d77c52a0000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789607784.908167:0:23975:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d77c52a0000 3 00010000:00080000:1.0:1789607784.908206:0:23975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d78fe136000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.125@tcp at head 00010000:00010000:1.0:1789607784.911762:0:23975:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789607784.912070:0:23975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789607784.912125:0:23975:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789607784.912150:0:23975:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa26202d240fbf2ce 00000100:00080000:1.0:1789607784.912165:0:23975:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789607784.912181:0:23975:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d78fe136000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:1.0:1789607784.912233:0:23975:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78cf7c7480 x1876539150165760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607784.912269:0:23975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789607784.915627:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150165760:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789607784.915741:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789607784.915898:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607784.915903:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607784.915906:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607784.915909:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607784.915949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607784.915953:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789607784.915957:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d78f06c2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607784.915964:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 687 00000100:00080000:0.0:1789607784.915971:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789607784.915982:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d78f06c2800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:0.0:1789607784.916019:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78fd115f80 x1876539150166400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607784.916081:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150165760 00000100:00100000:0.0:1789607784.916091:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150165760 00000100:00100000:0.0:1789607784.916133:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789607784.916143:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3467:x1876539150165760:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789607784.916174:0:21932:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:0.0:1789607784.916218:0:21932:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa26202d240fbf2d5 00000004:00100000:0.0:1789607784.916241:0:21932:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789607784.916280:0:21932:0:(import.c:65:import_set_state_nolock()) ffff8d77c52a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607784.916338:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3467:x1876539150165760:12345-0@lo:38:llog_process_th.0 Request processed in 195us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607784.916346:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789607784.916376:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150165888:0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.916410:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.916436:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150166528:0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.916473:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.916494:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607784.916500:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150166272:0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.916524:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.916557:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150166016:0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.916580:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.916601:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150166656:0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.916620:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.916637:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789607784.916652:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150166144:0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.916681:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.916702:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150166784:0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.916724:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.916762:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150166528 00000100:00100000:0.0:1789607784.916767:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150166528 00000100:00100000:0.0:1789607784.916796:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150166016 00000100:00100000:0.0:1789607784.916800:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150166016 00000100:00100000:0.0:1789607784.916814:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150166656 00000100:00100000:0.0:1789607784.916817:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150166656 00000100:00100000:0.0:1789607784.916844:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150166784 00000100:00100000:0.0:1789607784.916847:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150166784 00000100:00100000:0.0:1789607784.916896:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789607784.916905:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150166528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.916949:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150166528:12345-0@lo:400:kworker.0 Request processed in 46us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607784.916956:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789607784.916971:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789607784.916977:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150166016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.917010:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150166016:12345-0@lo:400:kworker.0 Request processed in 34us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607784.917017:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789607784.917029:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789607784.917035:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150166656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.917063:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150166656:12345-0@lo:400:kworker.0 Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607784.917070:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789607784.917091:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789607784.917098:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150166784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.917131:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3470:x1876539150166784:12345-0@lo:400:kworker.0 Request processed in 34us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607784.917137:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789607784.917156:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150165888 00000100:00100000:2.0:1789607784.917931:0:23246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150166272 00000100:00100000:2.0:1789607784.917942:0:23246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150166272 00000100:00100000:2.0:1789607784.917985:0:23246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607784.917994:0:23246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3469:x1876539150166272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607784.918054:0:23246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3469:x1876539150166272:12345-0@lo:400:kworker.0 Request processed in 61us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607784.918061:0:23246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607784.918112:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150166400:0@lo:8:kworker.0 00000100:00100000:2.0:1789607784.918146:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789607784.918201:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78cf7c7480 x1876539150165760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607784.918213:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789607784.918227:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1789607784.918236:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789607784.918243:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789607784.918247:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fe136000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789607784.918254:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3467:1876539150165760:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789607784.918289:0:23244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150166400 00000100:00100000:2.0:1789607784.918293:0:23244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150166400 00000100:00100000:2.0:1789607784.918320:0:23244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607784.918326:0:23244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c624b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3467:x1876539150166400:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789607784.918380:0:23244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c624b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3467:x1876539150166400:12345-0@lo:8:kworker.0 Request processed in 52us (232us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789607784.918386:0:23244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607784.918408:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789607784.918412:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f06c2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789607784.918427:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789607784.918430:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150166400:0@lo:8:kworker.0 00000100:00100000:0.0:1789607784.919574:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150165888 00000100:00100000:0.0:1789607784.919717:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150166144 00000100:00100000:0.0:1789607784.919721:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150166144 00000100:00100000:0.0:1789607784.919743:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789607784.919764:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150165888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.919889:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150165888:12345-0@lo:400:kworker.0 Request processed in 138us (3478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607784.919897:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789607784.919914:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789607784.919921:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150166144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.919951:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150166144:12345-0@lo:400:kworker.0 Request processed in 31us (3270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607784.919957:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789607784.919987:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607784.919993:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607784.919996:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789607784.920039:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f0701500 x1876539150166272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607784.920056:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150166272:0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.920072:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150165888:0@lo:400:kworker.0 00010000:00080000:0.0:1789607784.920098:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd116680 x1876539150166528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607784.920108:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150166528:0@lo:400:kworker.0 00000100:00100000:0.0:1789607784.920154:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150166144:0@lo:400:kworker.0 00010000:00080000:0.0:1789607784.920168:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd117480 x1876539150166784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607784.920177:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3470:1876539150166784:0@lo:400:kworker.0 00010000:00080000:0.0:1789607784.920189:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78f0702680 x1876539150166016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607784.920198:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150166016:0@lo:400:kworker.0 00010000:00080000:0.0:1789607784.920210:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78fd114380 x1876539150166656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607784.920219:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150166656:0@lo:400:kworker.0 00000020:01000004:2.0:1789607784.920533:0:23975:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789607784.920556:0:23975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d77c51319c0) 00000020:00000080:2.0:1789607784.920585:0:23975:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789607784.921141:0:23975:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d77c52a0000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789607784.921148:0:23975:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d77c52a0000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789607784.921151:0:23975:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d77c52a0000 3 00010000:00080000:2.0:1789607784.921190:0:23975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d77c5bc1800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.125@tcp at head 00010000:00010000:2.0:1789607784.924295:0:23975:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1789607784.929123:0:23975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789607784.929185:0:23975:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789607784.929204:0:23975:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa26202d240fbf2e3 00000100:00080000:2.0:1789607784.929219:0:23975:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607784.929256:0:23975:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d77c5bc1800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607784.929314:0:23975:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78c6248380 x1876539150166912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607784.929378:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3467:1876539150166912:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789607784.929466:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789607784.929596:0:23975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789607784.932416:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607784.932430:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789607784.932433:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789607784.932437:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789607784.935887:0:23975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:0.0:1789607784.936221:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150166912 00000100:00100000:0.0:1789607784.936234:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150166912 00000100:00100000:0.0:1789607784.936331:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607784.936341:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3467:x1876539150166912:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789607784.936381:0:23783:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:0.0:1789607784.936427:0:23783:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa26202d240fbf2ea 00000004:00100000:0.0:1789607784.936447:0:23783:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789607784.936492:0:23783:0:(import.c:65:import_set_state_nolock()) ffff8d78fd2dd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607784.936612:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3467:x1876539150166912:12345-0@lo:38:llog_process_th.0 Request processed in 270us (7144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607784.936969:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789607784.937055:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d78c6248380 x1876539150166912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607784.937069:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789607784.937082:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1789607784.937092:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789607784.937097:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789607784.937100:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d77c5bc1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789607784.937107:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3467:1876539150166912:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1789607784.937444:0:23965:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789607784.937491:0:23965:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789607784.937517:0:23965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbf2b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf2c0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.937530:0:23965:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c400/0xa26202d240fbf2b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf2c0 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789607784.937609:0:23965:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789607784.937611:0:23965:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789607784.937613:0:23965:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607784.937614:0:23965:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607784.937615:0:23965:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607784.937617:0:23965:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607784.937618:0:23965:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607784.937620:0:23965:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607784.937622:0:23965:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789607784.937970:0:23965:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789607784.937975:0:23965:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789607784.937976:0:23965:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789607784.937977:0:23965:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607784.937978:0:23965:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607784.937979:0:23965:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607784.937980:0:23965:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607784.937982:0:23965:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607784.937983:0:23965:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607784.937984:0:23965:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789607784.938015:0:23965:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789607784.938037:0:23965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150167040:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789607784.938133:0:23965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607784.938468:0:23965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78cfc58240 going to sleep for 11 seconds 00000100:00100000:0.0:1789607784.941807:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150167040 00000100:00100000:0.0:1789607784.941830:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150167040 00000100:00100000:0.0:1789607784.942060:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789607784.942076:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+24:23965:x1876539150167040:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789607784.942122:0:21925:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789607784.942142:0:21925:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789607784.992957:0:21925:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789607784.992978:0:21925:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789607784.993297:0:21946:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789607784.993305:0:21946:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789607784.993337:0:21946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.993361:0:21946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf25e expref: 24 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.993370:0:21946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c3f65200/0xa26202d240fbf273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf26c expref: 24 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.993378:0:21946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.993429:0:21946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c3f65200/0xa26202d240fbf273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbf26c expref: 24 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.993447:0:21946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78c3f65200/0xa26202d240fbf273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbf26c expref: 24 pid: 21923 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607784.993463:0:21946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150167168:0@lo:104: 00000100:00100000:3.0:1789607784.993552:0:21946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607784.993618:0:21946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbf25e expref: 24 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.993627:0:21946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbf25e expref: 24 pid: 21924 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607784.993636:0:21946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150167296:0@lo:104: 00000100:00100000:3.0:1789607784.993676:0:21946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607784.993696:0:21946:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f643e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789607784.993719:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150167168 00000100:00100000:3.0:1789607784.993728:0:21914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150167168 00000100:00100000:3.0:1789607784.993786:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150167296 00000100:00100000:3.0:1789607784.993790:0:21914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150167296 00000100:00100000:3.0:1789607784.993805:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789607784.993815:0:21914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+4:21946:x1876539150167168:12345-0@lo:104: 00010000:00010000:3.0:1789607784.993831:0:21914:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf273 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.993922:0:21914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607784.993929:0:21914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+4:21946:x1876539150167168:12345-0@lo:104: Request processed in 115us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607784.993936:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789607784.993956:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789607784.993962:0:21914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:21946:x1876539150167296:12345-0@lo:104: 00010000:00010000:3.0:1789607784.993970:0:21914:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf265 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607784.994004:0:21914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789607784.994009:0:21914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:21946:x1876539150167296:12345-0@lo:104: Request processed in 48us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607784.994016:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789607784.994053:0:21946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150167168:0@lo:104: 00000100:00100000:3.0:1789607784.994062:0:21946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21946:1876539150167296:0@lo:104: 00010000:00010000:3.0:1789607784.994084:0:21946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.995895:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607784.995912:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf273 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.995926:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59da00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607784.995931:0:21918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbf273 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.995942:0:21918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbf273 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607784.995973:0:21918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbf273 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607784.995978:0:21918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789607784.996040:0:21918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf273 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.996047:0:21918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607784.996073:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf273 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.996081:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf26c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf273 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.996096:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607784.996099:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf265 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.996105:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59c600 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607784.996108:0:21918:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbf265 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.996114:0:21918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbf265 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607784.996119:0:21918:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbf265 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607784.996125:0:21918:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789607784.996146:0:21918:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf265 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.996152:0:21918:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607784.996159:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf265 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.996166:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78fd59c600/0xa26202d240fbf25e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf265 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607784.996182:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607784.996184:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607784.996185:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607784.997038:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607784.997067:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150167424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607784.997158:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.997219:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607784.997225:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150167552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607784.997248:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607784.997536:0:21917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150167424 00000100:00100000:0.0:1789607784.997548:0:21917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150167424 00010000:00010000:0.0:1789607784.997589:0:21917:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c3f65200/0xa26202d240fbf273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf26c expref: 25 pid: 21923 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607784.997637:0:21917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150167552 00000100:00100000:0.0:1789607784.997641:0:21917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150167552 00010000:00010000:0.0:1789607784.997655:0:21917:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf25e expref: 26 pid: 21924 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607784.997671:0:21917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607784.997681:0:21917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77c69b89-f077-4f20-ab40-68d85082562e+26:3468:x1876539150167424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607784.997696:0:21917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607784.997701:0:21917:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c3f65200/0xa26202d240fbf273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf26c expref: 26 pid: 21923 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.997713:0:21917:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c3f65200/0xa26202d240fbf273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbf26c expref: 26 pid: 21923 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.997732:0:21917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c3f65200/0xa26202d240fbf273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbf26c expref: 26 pid: 21923 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.997757:0:21917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607784.997801:0:21917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77c69b89-f077-4f20-ab40-68d85082562e+25:3468:x1876539150167424:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607784.997809:0:21917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607784.997828:0:21917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607784.997834:0:21917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77c69b89-f077-4f20-ab40-68d85082562e+24:3468:x1876539150167552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607784.997842:0:21917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607784.997846:0:21917:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf25e expref: 24 pid: 21924 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.997855:0:21917:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbf25e expref: 24 pid: 21924 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.997895:0:21917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59d600/0xa26202d240fbf265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbf25e expref: 24 pid: 21924 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.997907:0:21917:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.997916:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789607784.997939:0:21917:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011993814s 00010000:00010000:0.0:1789607784.997945:0:21917:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.997953:0:21917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.997960:0:21917:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.997968:0:21917:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.997975:0:21917:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607784.997981:0:21917:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.997990:0:21917:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.998009:0:21917:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.998027:0:21917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607784.998053:0:21917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77c69b89-f077-4f20-ab40-68d85082562e+23:3468:x1876539150167552:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607784.998059:0:21917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607784.998106:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150167552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607784.998116:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150167424:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607784.998146:0:21946:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.998156:0:21946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607784.998163:0:21946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7900ef8e00/0xa26202d240fbf2f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607785.010323:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+22:23965:x1876539150167040:12345-0@lo:253:mount.lustre.0 Request processed in 68236us (72175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607785.010344:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789607785.010466:0:23965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77c69b89-f077-4f20-ab40-68d85082562e:23965:1876539150167040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789607785.010489:0:23965:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789607785.010493:0:23965:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607785.010495:0:23965:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789607785.010497:0:23965:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607785.010498:0:23965:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607785.010500:0:23965:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607785.010501:0:23965:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607785.010502:0:23965:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607785.010505:0:23965:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607785.010507:0:23965:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789607785.010537:0:23965:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789607785.011150:0:23965:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607785.011330:0:23965:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607785.011504:0:23965:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607785.011646:0:23965:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607785.011803:0:23965:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607785.012025:0:23965:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789607785.013659:0:23965:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1789607785.107232:0:23965:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789607785.107247:0:23965:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789607785.107298:0:23965:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789607785.107379:0:23965:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789607785.107398:0:23965:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789607785.107437:0:23965:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789607785.378279:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789607785.782657:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1789607785.782688:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000040:00080000:1.0:1789607785.826715:0:21964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789607786.415050:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789607786.722616:0:21927:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789607786.722628:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d77c610b000 from 14 10000000:01000000:1.0:1789607786.722636:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789607786.722701:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf2f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607786.722733:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf2f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607786.722764:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf2f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607786.722798:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150167680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607786.722994:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607786.723257:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c12edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607786.723321:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150167680 00000100:00100000:0.0:1789607786.723333:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150167680 00000100:00100000:0.0:1789607786.723405:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789607786.723428:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+22:21927:x1876539150167680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607786.723448:0:21923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607786.723467:0:21923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf2ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf2f8 expref: -99 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607786.723499:0:21923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf2ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf2f8 expref: 23 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607786.723512:0:21923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c3f64800/0xa26202d240fbf2ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf2f8 expref: 23 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607786.723522:0:21923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c3f64800, rc 0) 00000100:00100000:0.0:1789607786.723670:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+23:21927:x1876539150167680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 244us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607786.723678:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789607786.725027:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150167680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607786.725303:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf2f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf2ff expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607786.725318:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf2f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf2ff expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607786.725420:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150167808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789607786.725493:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607786.726562:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150167808 00000100:00100000:0.0:1789607786.726576:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150167808 00000100:00100000:0.0:1789607786.726649:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789607786.726661:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790102ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+23:21927:x1876539150167808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789607786.726693:0:21925:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789607786.726721:0:21925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789607786.726725:0:21925:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1789607786.726896:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790102ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+23:21927:x1876539150167808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 237us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607786.726905:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789607786.731921:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c12edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789607786.731988:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150167808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789607786.732556:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789607786.732570:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf2f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf2ff expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607786.732645:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76400/0xa26202d240fbf2f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf2ff expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607786.732674:0:21927:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789607786.732678:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d78c2f72000 from 14 10000000:01000000:1.0:1789607786.732681:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789607786.732728:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76a00/0xa26202d240fbf306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607786.733201:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76a00/0xa26202d240fbf306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607786.733218:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76a00/0xa26202d240fbf306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607786.733251:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150167936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607786.733346:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607786.733561:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0628180 going to sleep for 11 seconds 00000100:00100000:0.0:1789607786.733664:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150167936 00000100:00100000:0.0:1789607786.733675:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150167936 00000100:00100000:0.0:1789607786.733754:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789607786.733767:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+23:21927:x1876539150167936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607786.733798:0:21923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607786.733816:0:21923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c3f65e00/0xa26202d240fbf30d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf306 expref: -99 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607786.733847:0:21923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c3f65e00/0xa26202d240fbf30d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf306 expref: 24 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607786.733885:0:21923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c3f65e00/0xa26202d240fbf30d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf306 expref: 24 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607786.733895:0:21923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c3f65e00, rc 0) 00000100:00100000:0.0:1789607786.733943:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+24:21927:x1876539150167936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607786.733951:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789607786.734463:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150167936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607786.734490:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76a00/0xa26202d240fbf306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf30d expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607786.734502:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76a00/0xa26202d240fbf306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf30d expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607786.734965:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150168064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789607786.735029:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607786.735311:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0628180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607786.739354:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150168064 00000100:00100000:2.0:1789607786.739377:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150168064 00000100:00100000:2.0:1789607786.739461:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789607786.739474:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d9471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+24:21927:x1876539150168064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789607786.739515:0:21924:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789607786.739541:0:21924:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789607786.739545:0:21924:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1789607786.739754:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d9471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+24:21927:x1876539150168064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 283us (4724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607786.739762:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789607786.739819:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150168064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789607786.739936:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789607786.739953:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76a00/0xa26202d240fbf306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf30d expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607786.739966:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fcf76a00/0xa26202d240fbf306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf30d expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607787.427157:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607787.748997:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150168192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789607787.749088:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607787.749179:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150168192 00000100:00100000:3.0:1789607787.749191:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150168192 00000100:00080000:2.0:1789607787.749250:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607787.749278:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607787.749297:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150168192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607787.749350:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607787.749650:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150168192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 360us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607787.749668:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789607787.750757:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d790133e300 x1876539150168192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607787.750773:0:3470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1789607787.750801:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150168192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607788.007070:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607768/real 1789607768] req@ffff8d78cf7c6300 x1876539150154240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607788 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607788.007107:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78cf7c6300 x1876539150154240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607788 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607788.008480:0:3467:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607768/real 1789607768] req@ffff8d78cf7c4000 x1876539150154368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607788 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607788.008511:0:3467:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d78cf7c4000 x1876539150154368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607788 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789607788.008538:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fcd69000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607788.008567:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789607788.008587:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150154240:0@lo:8:kworker.0 00000100:00080000:0.0:1789607788.008594:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c7c35800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607788.008600:0:3467:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789607788.008603:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150154368:0@lo:8:kworker.0 00000100:00100000:3.0:1789607788.008902:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77c69b89-f077-4f20-ab40-68d85082562e:3471:1876539150168320:0@lo:400:kworker.0 00000100:00100000:3.0:1789607788.009000:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607788.009109:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150168320 00000100:00100000:0.0:1789607788.009121:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150168320 00000100:00100000:0.0:1789607788.009189:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789607788.009200:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78d9472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+24:3471:x1876539150168320:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789607788.009327:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607788.009331:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789607788.009335:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d78fcd69000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789607788.009341:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 673 00000100:00080000:2.0:1789607788.009346:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789607788.009357:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d78fcd69000 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607788.009383:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78c624bb80 x1876539150168576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789607788.009400:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607788.009403:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789607788.009412:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d78c7c35800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789607788.009426:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 673 00000100:00080000:2.0:1789607788.009429:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789607788.009435:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d78c7c35800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607788.009451:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78c624ad80 x1876539150168704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607788.009985:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78d9472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+24:3471:x1876539150168320:12345-0@lo:400:kworker.0 Request processed in 785us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607788.009995:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789607788.010048:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150168960:0@lo:400:kworker.0 00000100:00100000:0.0:1789607788.010089:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607788.010131:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150168448:0@lo:400:kworker.0 00000100:00100000:0.0:1789607788.010157:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607788.010176:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607788.010182:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150168832:0@lo:400:kworker.0 00000100:00100000:0.0:1789607788.010209:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607788.010260:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150168960 00000100:00100000:0.0:1789607788.010267:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150168960 00000100:00100000:0.0:1789607788.010301:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150168448 00000100:00100000:0.0:1789607788.010304:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150168448 00000100:00100000:0.0:1789607788.010321:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789607788.010328:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150168960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607788.010376:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150168960:12345-0@lo:400:kworker.0 Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607788.010395:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789607788.010412:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789607788.010573:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150168448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607788.010611:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150168448:12345-0@lo:400:kworker.0 Request processed in 42us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607788.010616:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789607788.010642:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150168832 00000100:00100000:0.0:1789607788.010646:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150168832 00000100:00100000:0.0:1789607788.010671:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789607788.010677:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150168832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607788.010707:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3468:x1876539150168832:12345-0@lo:400:kworker.0 Request processed in 31us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607788.010713:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789607788.010760:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150168960:0@lo:400:kworker.0 00010000:00080000:0.0:1789607788.010790:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c624aa00 x1876539150168832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607788.010800:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3468:1876539150168832:0@lo:400:kworker.0 00000100:00100000:0.0:1789607788.010809:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150168448:0@lo:400:kworker.0 00000100:00100000:0.0:1789607788.010830:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150168576:0@lo:8:kworker.0 00000100:00100000:0.0:1789607788.010887:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607788.010920:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150168704:0@lo:8:kworker.0 00000100:00100000:0.0:1789607788.010942:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607788.010977:0:23246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150168576 00000100:00100000:0.0:1789607788.010989:0:23246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150168576 00000100:00100000:0.0:1789607788.011012:0:23246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150168704 00000100:00100000:0.0:1789607788.011015:0:23246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150168704 00000100:00100000:0.0:1789607788.011033:0:23246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607788.011038:0:23246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3467:x1876539150168576:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789607788.011068:0:23246:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:0.0:1789607788.011111:0:23246:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbf314 00002000:00100000:0.0:1789607788.011128:0:23246:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d77c5bc2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789607788.011132:0:23246:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789607788.011135:0:23246:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789607788.011582:0:23246:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789607788.011614:0:23246:0:(import.c:65:import_set_state_nolock()) ffff8d77c5bc4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607788.011672:0:23246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3467:x1876539150168576:12345-0@lo:8:kworker.0 Request processed in 631us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607788.011679:0:23246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607788.011701:0:23246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607788.011705:0:23246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3467:x1876539150168704:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789607788.011735:0:23246:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:0.0:1789607788.011756:0:23246:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa26202d240fbf31b 00002000:00100000:0.0:1789607788.011765:0:23246:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d77c5bc3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789607788.011769:0:23246:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789607788.011772:0:23246:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789607788.012075:0:23246:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789607788.012091:0:23246:0:(import.c:65:import_set_state_nolock()) ffff8d77c5bc6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607788.012125:0:23246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3467:x1876539150168704:12345-0@lo:8:kworker.0 Request processed in 419us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607788.012132:0:23246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789607788.012197:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c624bb80 x1876539150168576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607788.012208:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789607788.012216:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789607788.012226:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789607788.012330:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607788.012336:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789607788.012340:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d78f06c2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789607788.012353:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d78f06c2800 using connection 192.168.203.125@tcp/0@lo 00000100:00100000:2.0:1789607788.012383:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d78c6248e00 x1876539150169088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607788.013451:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150169344:0@lo:400:kworker.0 00000100:00100000:1.0:1789607788.013523:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607788.013566:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607788.013572:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150169472:0@lo:400:kworker.0 00000100:00100000:1.0:1789607788.013600:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607788.013631:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150169600:0@lo:400:kworker.0 00000100:00100000:1.0:1789607788.013662:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607788.013682:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789607788.013688:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150169216:0@lo:400:kworker.0 00000100:00100000:1.0:1789607788.013921:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607788.013945:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150169728:0@lo:400:kworker.0 00000100:00100000:1.0:1789607788.013976:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607788.014003:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150169344 00000100:00100000:1.0:1789607788.014012:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150169344 00000100:00100000:1.0:1789607788.014070:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150169472 00000100:00100000:1.0:1789607788.014074:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150169472 00000100:00100000:1.0:1789607788.014091:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150169600 00000100:00100000:1.0:1789607788.014094:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150169600 00000100:00100000:1.0:1789607788.014110:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150169216 00000100:00100000:1.0:1789607788.014112:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150169216 00000100:00100000:1.0:1789607788.014124:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150169728 00000100:00100000:1.0:1789607788.014127:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150169728 00000100:00100000:1.0:1789607788.014147:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607788.014165:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150169344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607788.014225:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3468:x1876539150169344:12345-0@lo:400:kworker.0 Request processed in 63us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607788.014232:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789607788.014251:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789607788.014258:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150169472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607788.014289:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3468:x1876539150169472:12345-0@lo:400:kworker.0 Request processed in 32us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607788.014296:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789607788.014309:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789607788.014316:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150169600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607788.014572:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3470:x1876539150169600:12345-0@lo:400:kworker.0 Request processed in 258us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607788.014579:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789607788.014592:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607788.014599:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150169216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607788.014624:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150169216:12345-0@lo:400:kworker.0 Request processed in 27us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607788.014631:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607788.014642:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607788.014648:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150169728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607788.014677:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150169728:12345-0@lo:400:kworker.0 Request processed in 30us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607788.014683:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789607788.014937:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789607788.014950:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789607788.014988:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c6248380 x1876539150169216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607788.015006:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150169216:0@lo:400:kworker.0 00010000:00080000:1.0:1789607788.015019:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c624aa00 x1876539150169728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607788.015027:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150169728:0@lo:400:kworker.0 00010000:00080000:1.0:1789607788.015038:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c6249c00 x1876539150169600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607788.015045:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3470:1876539150169600:0@lo:400:kworker.0 00010000:00080000:1.0:1789607788.015082:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c6249500 x1876539150169472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607788.015091:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3468:1876539150169472:0@lo:400:kworker.0 00010000:00080000:1.0:1789607788.015102:0:3468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c6248700 x1876539150169344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607788.015110:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3468:1876539150169344:0@lo:400:kworker.0 00000100:00080000:0.0:1789607788.015816:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789607788.015826:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78fcd69000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789607788.015858:0:3467:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789607788.015882:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150168576:0@lo:8:kworker.0 00000100:00100000:3.0:1789607788.016064:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77c69b89-f077-4f20-ab40-68d85082562e:3471:1876539150168320:0@lo:400:kworker.0 00000004:00080000:0.0:1789607788.016152:0:21954:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789607788.016774:0:21954:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 692973910946ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789607788.018018:0:21955:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1789607788.018057:0:21955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21955:1876539150169984:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789607788.018145:0:21955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607788.018182:0:21955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607788.018207:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607788.018220:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150169856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607788.018312:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607788.018356:0:23246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150169984 00000100:00100000:0.0:1789607788.018365:0:23246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150169984 00000100:00100000:0.0:1789607788.018438:0:23246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607788.018450:0:23246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:21955:x1876539150169984:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789607788.019348:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150169856 00000100:00100000:3.0:1789607788.019358:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150169856 00000100:00100000:3.0:1789607788.019399:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607788.019408:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3469:x1876539150169856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607788.019433:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607788.019518:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3469:x1876539150169856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607788.019526:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789607788.020137:0:3467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c624ad80 x1876539150168704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607788.020154:0:3467:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789607788.020169:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789607788.020183:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789607788.020193:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789607788.020198:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78c7c35800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789607788.020228:0:3467:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789607788.020238:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3467:1876539150168704:0@lo:8:kworker.0 00000004:00080000:1.0:1789607788.020324:0:21957:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1789607788.020349:0:21957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21957:1876539150170240:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789607788.020401:0:21957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607788.020430:0:21957:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d3332240 going to sleep for 11 seconds 00000004:00080000:1.0:1789607788.020449:0:21956:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789607788.024072:0:21956:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 692981206034ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789607788.027034:0:3467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150169088:0@lo:8:kworker.0 00000100:00100000:1.0:1789607788.027149:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607788.027222:0:23852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150170240 00000100:00100000:1.0:1789607788.027232:0:23852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150170240 00000100:00100000:1.0:1789607788.027285:0:23852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150169088 00000100:00100000:1.0:1789607788.027288:0:23852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150169088 00000100:00100000:1.0:1789607788.027305:0:23852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607788.027316:0:23852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:21957:x1876539150170240:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789607788.030104:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150170112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607788.030235:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789607788.030392:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607788.030402:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1789607788.030495:0:23246:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789607788.030506:0:23246:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:0.0:1789607788.030513:0:23246:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00002000:00080000:1.0:1789607788.031785:0:23852:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789607788.031795:0:23852:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1789607788.031799:0:23852:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00010000:00080000:3.0:1789607788.032883:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd80000 x1876539150169856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607788.032919:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150169856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607788.032989:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150170112 00000100:00100000:3.0:1789607788.032999:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150170112 00000100:00100000:3.0:1789607788.033060:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607788.033071:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3469:x1876539150170112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607788.033118:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607788.033228:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3469:x1876539150170112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (2994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607788.033236:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789607788.033296:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78ff79e300 x1876539150170112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607788.033313:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150170112:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1789607788.055587:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.055601:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf322 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.055622:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.055627:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.055635:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.055656:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.055667:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.055675:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.055696:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607788.055712:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607788.055719:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.055736:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f65000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607788.055741:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.055766:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf322 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.055788:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf322 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.055796:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf322 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.055818:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607788.055819:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607788.055821:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789607788.056693:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.056701:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf329 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.056713:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.056716:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.056720:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.061438:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.061458:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.061481:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.061509:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789607788.062147:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:0.0:1789607788.062147:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.062159:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf330 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.062161:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e0a5df/0xa26202d240fbf337 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.062186:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.062187:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.062196:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.062197:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.062205:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.062206:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e0a5df/0xa26202d240fbf337 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062229:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062251:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062263:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.062264:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9e0a5df/0xa26202d240fbf337 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.062287:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e0a5df/0xa26202d240fbf337 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062294:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789607788.062296:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e0a5df/0xa26202d240fbf337 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062309:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607788.062311:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789607788.062318:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062337:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f64c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607788.062343:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062353:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf329 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062375:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf329 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062383:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf329 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062406:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607788.062410:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062417:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f65800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607788.062420:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062428:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf330 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062440:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf330 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062457:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf330 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062473:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607788.062477:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9e0a5df/0xa26202d240fbf337 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062485:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607788.062489:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e0a5df/0xa26202d240fbf337 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062497:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e0a5df/0xa26202d240fbf337 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062513:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9e0a5df/0xa26202d240fbf337 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062521:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9e0a5df/0xa26202d240fbf337 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.062541:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607788.062543:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607788.062546:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.063390:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.063402:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019339ddb/0xa26202d240fbf33e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.063417:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.063421:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.063426:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019339ddb/0xa26202d240fbf33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.063438:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019339ddb/0xa26202d240fbf33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.063447:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019339ddb/0xa26202d240fbf33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.063467:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019339ddb/0xa26202d240fbf33e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.063489:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.063503:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.063508:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019339ddb/0xa26202d240fbf33e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.063516:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.063521:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019339ddb/0xa26202d240fbf33e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.063530:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019339ddb/0xa26202d240fbf33e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.063545:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019339ddb/0xa26202d240fbf33e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.063553:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019339ddb/0xa26202d240fbf33e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.063568:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.063570:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.063572:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.064670:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.064687:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf345 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.064717:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.064721:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.064733:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.064748:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.064757:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.064764:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.064788:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.064803:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.064808:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.064815:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.064819:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.064828:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf345 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.064850:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf345 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.064857:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf345 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.065075:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.065078:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.065079:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.065536:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.065542:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf34c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.065552:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.065556:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.065561:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf34c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.065570:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf34c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.065578:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf34c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.065587:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf34c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.065617:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.065627:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.065631:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf34c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.065638:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.065642:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf34c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.065651:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf34c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.065664:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf34c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.065673:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf34c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.065689:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.065691:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.065692:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.066501:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.066510:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf353 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.066522:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.066531:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.066537:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.066548:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.066557:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf353 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.066564:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.066586:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.066599:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.066604:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.066612:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.066616:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf353 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.066625:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf353 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.066637:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf353 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.066656:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf353 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.066674:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.066676:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.066678:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607788.068323:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.069444:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.069457:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc34df49/0xa26202d240fbf35a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.069477:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.069483:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.069490:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc34df49/0xa26202d240fbf35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.069506:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc34df49/0xa26202d240fbf35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.069516:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc34df49/0xa26202d240fbf35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.069525:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc34df49/0xa26202d240fbf35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.069555:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607788.069765:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607788.069777:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc34df49/0xa26202d240fbf35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.069796:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77a00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607788.069802:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc34df49/0xa26202d240fbf35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.069814:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc34df49/0xa26202d240fbf35a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.069836:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc34df49/0xa26202d240fbf35a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.069845:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc34df49/0xa26202d240fbf35a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.069889:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607788.069891:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607788.069893:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.070648:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.070664:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fa4db65/0xa26202d240fbf361 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.070678:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.070682:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.070687:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fa4db65/0xa26202d240fbf361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.070698:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fa4db65/0xa26202d240fbf361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.070809:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fa4db65/0xa26202d240fbf361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.070818:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fa4db65/0xa26202d240fbf361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.070838:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.070852:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.070858:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fa4db65/0xa26202d240fbf361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.071055:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.071060:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fa4db65/0xa26202d240fbf361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.071070:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fa4db65/0xa26202d240fbf361 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.071093:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fa4db65/0xa26202d240fbf361 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.071101:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fa4db65/0xa26202d240fbf361 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.071120:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.071122:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.071125:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.071625:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.071633:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ac643b4/0xa26202d240fbf368 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.071643:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.071647:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.071652:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac643b4/0xa26202d240fbf368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.071663:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac643b4/0xa26202d240fbf368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.071673:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ac643b4/0xa26202d240fbf368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.071681:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ac643b4/0xa26202d240fbf368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.072347:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.072365:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.072373:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ac643b4/0xa26202d240fbf368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.072384:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.072389:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ac643b4/0xa26202d240fbf368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.072399:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ac643b4/0xa26202d240fbf368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.072416:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ac643b4/0xa26202d240fbf368 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.072423:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac643b4/0xa26202d240fbf368 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.072445:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.072447:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.072449:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.073405:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.073415:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf36f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.073428:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.073439:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.073446:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.073459:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.073468:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.073476:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.073498:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.073510:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.073516:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.073524:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bed400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.073528:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.073536:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf36f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.073549:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf36f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.073568:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf36f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.073589:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.073592:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.073594:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789607788.073774:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.073782:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf376 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.073793:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.073798:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.073802:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.073815:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.073831:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf376 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.073839:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.073885:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.074302:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.074309:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.074318:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f65000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.074323:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.074331:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf376 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.074344:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf376 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.074352:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf376 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.074368:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.074370:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.074373:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789607788.074631:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.074639:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf37d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.074649:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.074653:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.074657:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf37d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.074667:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf37d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.074676:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf37d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.074682:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf37d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607788.074695:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.074713:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf384 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.074723:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.074736:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.074740:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.074752:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.074761:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf384 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.074770:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.075001:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789607788.075580:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789607788.075611:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607788.075619:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf37d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.075629:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f64200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.075635:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf37d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.075658:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf37d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.075676:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf37d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.075684:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf37d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.075766:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.075771:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.075778:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bec200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.075781:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf384 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.075789:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf384 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.075801:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf384 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.075807:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf384 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.075832:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.075834:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.075836:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.076597:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.076606:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf392 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.076619:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.076624:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607788.076626:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.076631:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf392 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.076645:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf392 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.076655:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf392 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.076663:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf392 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.076681:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.076691:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.076695:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf392 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607788.076965:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.076974:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df6762ad/0xa26202d240fbf38b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.076983:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.076987:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.076991:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df6762ad/0xa26202d240fbf38b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.077003:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df6762ad/0xa26202d240fbf38b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.077011:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df6762ad/0xa26202d240fbf38b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.077020:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df6762ad/0xa26202d240fbf38b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.077036:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607788.077045:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.077066:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bec000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.077071:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf392 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077080:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf392 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077097:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf392 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077105:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf392 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077131:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.077134:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.077137:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.077674:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.077680:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf399 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077691:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.077694:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.077699:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf399 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077711:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf399 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077737:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf399 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077746:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf399 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077761:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.077769:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.077773:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf399 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077781:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bec800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.077785:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf399 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077794:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf399 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077807:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf399 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077814:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf399 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.077832:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.077840:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.077843:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789607788.078098:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.078107:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf3a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.078117:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.078127:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.078132:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf3a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.078143:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf3a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.078152:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf3a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.078160:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf3a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.078180:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.078185:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.078191:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf3a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.078199:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f65800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.078203:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf3a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.078212:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf3a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.078224:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf3a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.078231:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002469725a/0xa26202d240fbf3a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.078253:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.078256:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.078257:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.078813:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.078820:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf3a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.078830:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.078834:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.078847:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf3a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.078857:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf3a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.079093:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf3a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.079103:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf3a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.079125:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.079138:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.079143:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf3a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.079152:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bec600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.079158:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf3a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.079176:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf3a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.079194:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf3a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.079214:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf3a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.079228:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.079230:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.079232:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.079782:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.079791:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf3ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.079801:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.079806:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.079811:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf3ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.079822:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf3ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.079831:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf3ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.079839:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf3ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.079856:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.080049:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.080061:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf3ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.080070:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bec200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.080075:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf3ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.080084:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf3ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.080098:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf3ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.080105:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf3ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.080124:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.080127:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.080130:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789607788.080212:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.080220:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf3b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.080229:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.080233:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.080238:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.080250:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.080260:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.080275:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.080294:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.080303:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.080310:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.080318:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f64c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.080322:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.080341:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf3b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.080353:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf3b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.080701:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000471b041d/0xa26202d240fbf3b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.080956:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.080960:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.081025:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.081472:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.081480:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf3bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.081494:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.081498:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.081503:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf3bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.081515:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf3bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.081524:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf3bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.081538:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf3bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.081554:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.081563:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.081567:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf3bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.081574:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bed400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.081579:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf3bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.081586:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf3bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.081599:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf3bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.081606:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf3bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.081622:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.081624:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.081625:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.082253:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.082269:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf3c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.082280:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.082284:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.082289:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf3c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.082301:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf3c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.082310:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf3c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.082317:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf3c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.082332:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.082341:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.082344:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf3c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.082351:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bec800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.082355:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf3c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.082362:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf3c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.082381:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf3c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.082389:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020c8dcf3/0xa26202d240fbf3c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.082403:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.082405:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.082407:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.083090:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.083099:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf3ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.083109:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.083113:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.083119:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf3ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.083131:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf3ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.083140:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf3ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.083148:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf3ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.083185:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789607788.083679:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.083685:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf3d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.083694:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.083697:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.083700:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf3d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.083709:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf3d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.083717:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf3d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.083723:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf3d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.083744:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789607788.084393:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.084401:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf3d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.084410:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.084422:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.084427:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf3d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.084438:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf3d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.084446:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf3d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.084453:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf3d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.084463:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789607788.084633:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.084642:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf3df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.084653:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.084657:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.084662:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf3df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.084674:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf3df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.084683:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf3df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.084691:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.084701:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789607788.085171:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789607788.085181:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf3ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085191:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bec000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.085197:0:24106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf3ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085207:0:24106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf3ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085229:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf3ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085250:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c03f5fe/0xa26202d240fbf3ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085285:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df6762ad/0xa26202d240fbf38b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085293:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f65200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.085297:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df6762ad/0xa26202d240fbf38b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085306:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df6762ad/0xa26202d240fbf38b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085320:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df6762ad/0xa26202d240fbf38b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085328:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df6762ad/0xa26202d240fbf38b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085348:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789607788.085352:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf3d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085359:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bec400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.085362:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf3d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085377:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf3d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085388:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf3d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085396:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf3d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085415:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607788.085418:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf3d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085425:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bedc00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.085429:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf3d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085437:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf3d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085449:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf3d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085456:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf3d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085484:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.085488:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085495:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f64200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.085498:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085507:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf3df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085519:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf3df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085528:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088331fa6/0xa26202d240fbf3df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085547:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.085550:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.085553:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.085560:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.085562:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.085564:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.085827:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.085835:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf3e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.085856:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=693s v=(0 0) 00002000:00010000:0.0:1789607788.085938:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.085945:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf3ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086028:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.086036:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf3e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086049:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf3e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086058:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf3e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086067:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf3e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086087:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.086098:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.086102:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf3e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086110:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bece00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.086114:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf3e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086123:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf3e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.086125:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.086134:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.086140:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf3ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.086163:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf3ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086166:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf3e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.086179:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf3ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086183:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf3e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.086198:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf3ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086214:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607788.086217:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789607788.086219:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf3ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086228:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f65000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.086232:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf3ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086240:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf3ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086250:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf3ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086256:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000780eab20/0xa26202d240fbf3ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.086276:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.086279:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.086288:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.086296:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.087100:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.087110:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf3f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.087122:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.087127:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.087133:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf3f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607788.087137:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.087148:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf3f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.087157:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf3f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.087165:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf3f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.087181:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.087192:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.087196:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf3f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.087204:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5becc00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.087208:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf3f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.087229:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf3f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.087243:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf3f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.087251:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf3f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.087268:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.087271:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.087273:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789607788.087304:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.087312:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf3fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.087396:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.087400:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.087405:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf3fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.087416:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf3fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.087437:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf3fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.087444:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf3fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.087459:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789607788.087955:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.087962:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf402 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.087972:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.087976:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.087980:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.087990:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.087999:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf402 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088014:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088032:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789607788.088043:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607788.088048:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf3fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088055:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77a00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.088130:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf3fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088140:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf3fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088154:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf3fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088161:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf3fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088181:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.088184:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088202:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bed200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.088206:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088214:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088224:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf402 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088231:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf402 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607788.088238:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.088245:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607788.088246:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf409 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088249:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.088252:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.088261:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607788.088261:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.088267:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.088272:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf409 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.088283:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf409 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.088292:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf409 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.088299:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf409 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.088406:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.088502:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.088507:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf409 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088512:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.088514:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf409 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088529:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf409 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088537:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf409 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088541:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf409 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.088555:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.088556:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.088558:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789607788.089217:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.089225:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf410 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.089236:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.089240:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.089245:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf410 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.089255:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf410 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.089264:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf410 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.089273:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf410 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607788.089287:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.089296:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.089297:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9789773/0xa26202d240fbf417 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.089309:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.089312:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.089316:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9789773/0xa26202d240fbf417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.089327:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9789773/0xa26202d240fbf417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.089335:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9789773/0xa26202d240fbf417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.089350:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9789773/0xa26202d240fbf417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.089363:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.089369:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf410 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.089377:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.089381:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf410 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.089389:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf410 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.089404:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf410 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.089412:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf410 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.089445:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.089448:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.089451:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.089464:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789607788.090135:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.090143:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf41e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.090154:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.090164:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.090169:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.090180:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.090190:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf41e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.090198:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf41e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.090218:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789607788.090245:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607788.090258:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9789773/0xa26202d240fbf417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090266:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bed000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.090270:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9789773/0xa26202d240fbf417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090278:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9789773/0xa26202d240fbf417 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090292:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9789773/0xa26202d240fbf417 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090300:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9789773/0xa26202d240fbf417 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090321:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.090325:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf41e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090332:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.090335:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf41e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090343:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf41e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090366:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf41e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090374:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf41e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090391:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.090394:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.090397:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.090405:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.090607:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.090612:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf425 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090617:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.090619:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.090622:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf425 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090628:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf425 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090634:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf425 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090639:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf425 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090655:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.090662:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.090664:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf425 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090669:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bec200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.090671:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf425 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090676:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf425 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090683:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf425 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090689:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d4e03c4/0xa26202d240fbf425 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.090704:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.090705:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.090707:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789607788.091030:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1789607788.091099:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.091106:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf42c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.091115:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.091118:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.091122:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf42c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.091131:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf42c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.091139:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf42c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.091151:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf42c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.091169:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.091208:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.091214:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf42c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.091235:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.091239:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf42c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.091247:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf42c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.091264:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf42c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.091273:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf42c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.091295:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.091297:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.091300:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.091796:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.091803:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf433 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.091814:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.091817:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.091821:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf433 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.091831:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf433 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.091846:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf433 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.091855:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf433 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.091955:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.092031:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.092037:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf433 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092045:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bec600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.092048:0:24106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf433 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092056:0:24106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf433 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092069:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf433 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092077:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006502eea1/0xa26202d240fbf433 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092093:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.092101:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.092102:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.092571:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.092579:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a152a8/0xa26202d240fbf43a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092590:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.092594:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.092598:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010a152a8/0xa26202d240fbf43a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092609:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010a152a8/0xa26202d240fbf43a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092618:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a152a8/0xa26202d240fbf43a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092625:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010a152a8/0xa26202d240fbf43a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092642:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.092653:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.092657:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010a152a8/0xa26202d240fbf43a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092663:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bed800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.092666:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a152a8/0xa26202d240fbf43a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092686:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a152a8/0xa26202d240fbf43a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092697:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010a152a8/0xa26202d240fbf43a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092704:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010a152a8/0xa26202d240fbf43a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.092720:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.092721:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.092735:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.093306:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.093311:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc665cd1/0xa26202d240fbf441 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.093319:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.093321:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.093325:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc665cd1/0xa26202d240fbf441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.093331:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc665cd1/0xa26202d240fbf441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.093346:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc665cd1/0xa26202d240fbf441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.093356:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc665cd1/0xa26202d240fbf441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.093497:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.093506:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.093510:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc665cd1/0xa26202d240fbf441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.093515:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bed600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.093517:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc665cd1/0xa26202d240fbf441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.093522:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc665cd1/0xa26202d240fbf441 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.093530:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc665cd1/0xa26202d240fbf441 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.093535:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc665cd1/0xa26202d240fbf441 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.093544:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.093545:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.093546:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.093954:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.093967:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015449b12/0xa26202d240fbf448 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.093976:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.093979:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.093983:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015449b12/0xa26202d240fbf448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.093992:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015449b12/0xa26202d240fbf448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.094000:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015449b12/0xa26202d240fbf448 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.094006:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015449b12/0xa26202d240fbf448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.094021:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.094031:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.094035:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015449b12/0xa26202d240fbf448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.094043:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5beca00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.094978:0:24106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015449b12/0xa26202d240fbf448 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.094992:0:24106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015449b12/0xa26202d240fbf448 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.095023:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015449b12/0xa26202d240fbf448 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.095032:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015449b12/0xa26202d240fbf448 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.095076:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.095079:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.095081:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.095692:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:0.0:1789607788.095692:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.095706:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf44f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.095706:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf456 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.095734:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.095739:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.095754:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf44f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.095767:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf44f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.095776:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf44f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.095791:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.095793:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf44f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.095799:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.095804:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf456 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.095824:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf456 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.095837:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf456 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.095845:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607788.095846:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf456 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.095898:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789607788.095954:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607788.095961:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf44f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.095970:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5beda00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.095974:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf44f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.095989:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf44f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096001:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf44f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096009:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf44f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096024:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.096027:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf456 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096033:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.096035:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf456 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096055:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf456 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096066:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf456 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096073:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf456 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096091:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.096093:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.096095:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.096103:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.096649:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.096656:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf45d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096667:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.096671:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.096675:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf45d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096687:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf45d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096696:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf45d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096711:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf45d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096738:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.096750:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.096754:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf45d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096761:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bed200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.096765:0:24106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf45d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096773:0:24106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf45d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096785:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf45d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096791:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003227e1b9/0xa26202d240fbf45d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.096809:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.096811:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.096813:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.097336:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.097350:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf464 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097361:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.097364:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.097369:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf464 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097381:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf464 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097390:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf464 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097397:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf464 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097412:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.097421:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.097426:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf464 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097434:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5becc00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.097437:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf464 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097446:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf464 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097464:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf464 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097472:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9c405b8/0xa26202d240fbf464 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097486:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.097487:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.097489:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.097937:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.097943:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf46b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097952:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.097955:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.097959:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf46b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097968:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf46b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097976:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf46b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.097983:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf46b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098008:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.098018:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.098023:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf46b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098030:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bece00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.098033:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf46b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098042:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf46b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098053:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf46b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098061:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a492a48/0xa26202d240fbf46b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098075:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.098077:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.098079:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.098502:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.098510:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf472 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098520:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.098533:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.098537:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf472 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098549:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf472 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098557:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf472 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098565:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf472 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098581:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.098590:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.098595:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf472 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098602:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bedc00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.098606:0:24106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf472 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098615:0:24106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf472 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098626:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf472 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098644:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c65419f7/0xa26202d240fbf472 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.098662:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.098665:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.098667:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607788.101427:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.101510:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf479 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.101532:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=693s v=(0 0) 00010000:00010000:1.0:1789607788.101538:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607788.101546:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.101565:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.101578:0:23852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.101586:0:23852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.101612:0:23852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.101629:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.101642:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.101650:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bec400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.101655:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf479 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.101665:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf479 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.101685:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf479 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.101694:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000608a8840/0xa26202d240fbf479 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.101717:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.101719:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.101721:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789607788.102217:0:23852:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00002000:00010000:0.0:1789607788.104327:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.104347:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbf480 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.104384:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.104390:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.104397:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbf480 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.104415:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbf480 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.104428:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbf480 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.104436:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbf480 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.104456:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789607788.104904:0:23852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:21957:x1876539150170240:12345-0@lo:5:osp-pre-1-0.0 Request processed in 75027us (81938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607788.104920:0:23852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607788.105025:0:21957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21957:1876539150170240:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789607788.105046:0:21957:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1789607788.105112:0:21957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21957:1876539150170368:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789607788.105201:0:21957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607788.105238:0:21957:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d7901370f00 going to sleep for 11 seconds 00010000:00010000:1.0:1789607788.105279:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.105289:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbf480 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.105303:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.105308:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbf480 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.105321:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbf480 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.105344:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbf480 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.105352:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019339ddb/0xa26202d240fbf480 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.105377:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.105379:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.105381:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607788.105398:0:23245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150170368 00000100:00100000:1.0:1789607788.105406:0:23245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150170368 00002000:00010000:0.0:1789607788.105626:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.105634:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbf487 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.105646:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.105650:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.105656:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbf487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.105668:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbf487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.105690:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbf487 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.105699:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbf487 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.105717:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789607788.106615:0:23245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789607788.106626:0:23245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3467:x1876539150169088:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789607788.106676:0:23245:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1789607788.106740:0:23245:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa26202d240fbf48e 00002000:00100000:1.0:1789607788.106761:0:23245:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d77c6197800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789607788.106766:0:23245:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1789607788.106769:0:23245:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789607788.107370:0:23245:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789607788.107403:0:23245:0:(import.c:65:import_set_state_nolock()) ffff8d77c6192000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607788.107583:0:23245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3467:x1876539150169088:12345-0@lo:8:kworker.0 Request processed in 956us (80433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607788.107593:0:23245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789607788.107626:0:23245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789607788.107637:0:23245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:21957:x1876539150170368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789607788.107686:0:23245:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00002000:00010000:0.0:1789607788.110069:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.110085:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf495 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.110107:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.110113:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.110121:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf495 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.110140:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf495 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.110153:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf495 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.110162:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.110200:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00080000:2.0:1789607788.110719:0:3467:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789607788.110740:0:3467:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789607788.110749:0:3467:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789607788.110754:0:3467:0:(import.c:65:import_set_state_nolock()) ffff8d78f06c2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789607788.110781:0:3467:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789607788.110794:0:3467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3467:1876539150169088:0@lo:8:kworker.0 00000004:00080000:2.0:1789607788.110895:0:22579:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789607788.110924:0:22579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22579:1876539150170624:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1789607788.111005:0:22579:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607788.111033:0:22579:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e084d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607788.111048:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607788.111058:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150170496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789607788.111085:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607788.111135:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150170496 00000100:00100000:2.0:1789607788.111143:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150170496 00000100:00100000:2.0:1789607788.111206:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607788.111216:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c624bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3471:x1876539150170496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789607788.111240:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 131072 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607788.111287:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c624bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3471:x1876539150170496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607788.111295:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789607788.111317:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607788.111346:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150170496:0@lo:13:osp-pre-1-1.0 00002000:00010000:0.0:1789607788.111387:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.111398:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf49c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.111412:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.111416:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.111421:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf49c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.111434:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf49c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.111444:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf49c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.111452:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf49c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.111550:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789607788.112663:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.112674:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf4a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.112689:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.112699:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.112706:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf4a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.112792:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf4a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.112805:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf4a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.112812:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf4a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.112824:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789607788.113992:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.114005:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf4aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.114021:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.114026:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.114032:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf4aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.114044:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf4aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.114053:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf4aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.114070:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf4aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.114081:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1789607788.114585:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789607788.114596:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbf487 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.114607:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.114613:0:24106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbf487 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.114624:0:24106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbf487 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.114647:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbf487 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.114670:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9e0a5df/0xa26202d240fbf487 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.114698:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789607788.114703:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.114710:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.114714:0:24106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.114723:0:24106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.114743:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf495 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607788.114891:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.114898:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf4b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.114909:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.114913:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.114917:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf4b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.114928:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf4b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.114937:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf4b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.114946:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf4b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.114958:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789607788.115028:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ae7b067/0xa26202d240fbf495 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115047:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789607788.115052:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf49c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115060:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.115072:0:24106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf49c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115081:0:24106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf49c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115094:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf49c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115102:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be01c74a/0xa26202d240fbf49c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115119:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789607788.115124:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf4a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115131:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.115135:0:24106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf4a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115143:0:24106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf4a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115153:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf4a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115160:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e38d5f2c/0xa26202d240fbf4a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115186:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607788.115189:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf4aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115196:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf76600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.115199:0:24106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf4aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115206:0:24106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf4aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115218:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf4aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115225:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fa4db65/0xa26202d240fbf4aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115240:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.115243:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf4b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115249:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.115251:0:24106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf4b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115271:0:24106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115281:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf4b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115288:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac643b4/0xa26202d240fbf4b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.115302:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.115305:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.115307:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789607788.115813:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.115822:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf4b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.115840:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.115844:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.115849:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf4b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.115890:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf4b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.115900:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf4b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.115909:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf4b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.115939:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789607788.116971:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.116982:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbf4bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.116995:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.117000:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.117004:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbf4bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.117016:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbf4bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.117039:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbf4bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.117048:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbf4bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.117058:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789607788.118416:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.118431:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbf4c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.118449:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.118453:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.118459:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbf4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.118551:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbf4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.118633:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbf4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.118644:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbf4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.118671:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789607788.118917:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789607788.118927:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf4b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.118936:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fcf77a00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607788.118942:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf4b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.118951:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf4b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.118975:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf4b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.118983:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc34df49/0xa26202d240fbf4b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.119020:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607788.119024:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbf4bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.119030:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0030e00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607788.119033:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbf4bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.119042:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbf4bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.119052:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbf4bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.119059:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000056699be/0xa26202d240fbf4bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.119073:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607788.119076:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbf4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.119082:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c0030400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607788.119085:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbf4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.119104:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbf4c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.119116:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbf4c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.119123:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb928066/0xa26202d240fbf4c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.119137:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607788.119138:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607788.119140:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789607788.119670:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.119680:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047fad22/0xa26202d240fbf4cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.119692:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.119696:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.119701:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000047fad22/0xa26202d240fbf4cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.119712:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000047fad22/0xa26202d240fbf4cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.119795:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047fad22/0xa26202d240fbf4cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.119804:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000047fad22/0xa26202d240fbf4cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.119831:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789607788.120149:0:23244:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789607788.120163:0:23244:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:1.0:1789607788.120267:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.120276:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000047fad22/0xa26202d240fbf4cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.120287:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f0200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.120291:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000047fad22/0xa26202d240fbf4cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.120302:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000047fad22/0xa26202d240fbf4cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.120318:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000047fad22/0xa26202d240fbf4cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.120333:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000047fad22/0xa26202d240fbf4cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.120355:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.120357:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.120360:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789607788.120375:0:22578:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:2.0:1789607788.120844:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789607788.121069:0:22578:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 693078205737ns, next at 0ns, rc = 0 00002000:00010000:0.0:1789607788.121159:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607788.121168:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008698d95d/0xa26202d240fbf4d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.121180:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.121190:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.121197:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008698d95d/0xa26202d240fbf4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.121211:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008698d95d/0xa26202d240fbf4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.121221:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008698d95d/0xa26202d240fbf4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.121229:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008698d95d/0xa26202d240fbf4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.121246:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607788.122094:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607788.122105:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008698d95d/0xa26202d240fbf4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.122116:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f0000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607788.122122:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008698d95d/0xa26202d240fbf4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.122133:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008698d95d/0xa26202d240fbf4d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.122152:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008698d95d/0xa26202d240fbf4d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.122161:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008698d95d/0xa26202d240fbf4d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607788.122177:0:23246:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607788.122181:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607788.122186:0:23246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e12a4fa/0xa26202d240fbf4db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607788.122191:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.122194:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607788.122199:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=693s v=(0 0) 00010000:00010000:0.0:1789607788.122204:0:23246:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607788.122208:0:23246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e12a4fa/0xa26202d240fbf4db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.122219:0:23246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e12a4fa/0xa26202d240fbf4db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.122228:0:23246:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e12a4fa/0xa26202d240fbf4db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.122244:0:23246:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e12a4fa/0xa26202d240fbf4db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607788.122267:0:23246:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607788.122342:0:21918:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607788.122349:0:21918:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e12a4fa/0xa26202d240fbf4db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.122358:0:21918:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f0800 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607788.122362:0:21918:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e12a4fa/0xa26202d240fbf4db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.122370:0:21918:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e12a4fa/0xa26202d240fbf4db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.122383:0:21918:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e12a4fa/0xa26202d240fbf4db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.122397:0:21918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e12a4fa/0xa26202d240fbf4db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607788.122412:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607788.122414:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607788.122415:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607788.122829:0:23245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:21957:x1876539150170368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15191us (17624us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789607788.122842:0:23245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607788.122901:0:23245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150170624 00000100:00100000:2.0:1789607788.122911:0:23245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150170624 00000100:00100000:2.0:1789607788.122947:0:23245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789607788.122957:0:23245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c624ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:22579:x1876539150170624:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789607788.123531:0:21957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21957:1876539150170368:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789607788.123549:0:21957:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1789607788.123578:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789607788.124022:0:23246:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1789607788.125680:0:23246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:21955:x1876539150169984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 107224us (107528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607788.125695:0:23246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607788.126702:0:21955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21955:1876539150169984:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789607788.126857:0:21955:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:0.0:1789607788.126950:0:21955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd81c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21955:1876539150170752:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789607788.127012:0:21955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607788.127045:0:21955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789607788.129446:0:23244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150170752 00000100:00100000:1.0:1789607788.129466:0:23244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150170752 00000100:00100000:1.0:1789607788.129531:0:23244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789607788.129544:0:23244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:21955:x1876539150170752:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789607788.129613:0:23244:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00002000:00080000:2.0:1789607788.140687:0:23245:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789607788.140701:0:23245:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789607788.140836:0:23245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c624ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:22579:x1876539150170624:12345-0@lo:7:osp-pre-1-1.0 Request processed in 17873us (29823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607788.140850:0:23245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607788.141289:0:22579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22579:1876539150170624:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789607788.141314:0:22579:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789607788.141449:0:23244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:21955:x1876539150170752:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11905us (14433us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789607788.141458:0:23244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789607788.141500:0:21955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd81c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21955:1876539150170752:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789607788.141502:0:22579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd80a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22579:1876539150170880:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789607788.141516:0:21955:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:0.0:1789607788.141553:0:22579:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607788.142652:0:22579:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607788.145234:0:23246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150170880 00000100:00100000:1.0:1789607788.145252:0:23246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150170880 00000100:00100000:1.0:1789607788.145330:0:24107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789607788.145343:0:24107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:22579:x1876539150170880:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789607788.145387:0:24107:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789607788.145493:0:24107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:22579:x1876539150170880:12345-0@lo:5:osp-pre-1-1.0 Request processed in 152us (3940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607788.145501:0:24107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789607788.145574:0:22579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd80a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22579:1876539150170880:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789607788.145591:0:22579:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789607788.145645:0:22579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22579:1876539150171008:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789607788.145685:0:22579:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607788.145712:0:22579:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78fb803900 going to sleep for 11 seconds 00000100:00100000:1.0:1789607788.145740:0:23245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150171008 00000100:00100000:1.0:1789607788.145744:0:23245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150171008 00000100:00100000:1.0:1789607788.145780:0:23244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789607788.145790:0:23244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:22579:x1876539150171008:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789607788.147305:0:23244:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000100:00100000:1.0:1789607788.186214:0:23244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:22579:x1876539150171008:12345-0@lo:5:osp-pre-1-1.0 Request processed in 40416us (40519us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789607788.186229:0:23244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607788.186600:0:22579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22579:1876539150171008:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789607788.186623:0:22579:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1789607788.186684:0:22579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:22579:1876539150171136:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789607788.186749:0:22579:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607788.186787:0:22579:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c2fa2000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607788.186799:0:21942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150171136 00000100:00100000:3.0:1789607788.186809:0:21942:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150171136 00000100:00100000:3.0:1789607788.186891:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607788.186903:0:21942:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22579:x1876539150171136:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789607788.187043:0:21942:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22579:x1876539150171136:12345-0@lo:900:osp-pre-1-1.0 Request processed in 143us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607788.187051:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789607788.187166:0:22579:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fcd82680 x1876539150171136/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789607804 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607788.187180:0:22579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:22579:1876539150171136:0@lo:900:osp-pre-1-1.0 00000004:00080000:2.0:1789607788.203635:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789607788.204274:0:7270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789607788.258738:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150171264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607788.258810:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607788.258952:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150171264 00000100:00100000:1.0:1789607788.258960:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150171264 00000100:00100000:1.0:1789607788.259017:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789607788.259027:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150171264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789607788.259069:0:21935:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607788.259688:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150171264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 660us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607788.259707:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789607788.259877:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607788.259891:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78ff79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150171392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607788.259930:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607788.260017:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150171392 00000100:00100000:1.0:1789607788.260023:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150171392 00000100:00100000:1.0:1789607788.260060:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607788.260078:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150171392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789607788.260118:0:21936:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789607788.260203:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150171392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607788.260219:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789607788.262472:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150171264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607788.262624:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78ff79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150171392:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789607788.451796:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607789.475610:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789607790.245464:0:22590:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1789607790.433297:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789607790.433327:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:00080000:2.0:1789607790.433341:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1789607790.433348:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:0.0:1789607790.498089:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789607790.930235:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789607790.930262:0:8140:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00010000:00010000:1.0:1789607791.523143:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607792.547048:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789607792.760368:0:24328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg325-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789607792.866894:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607792.866926:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150171520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607792.867017:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607792.867102:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150171520 00000100:00100000:3.0:1789607792.867112:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150171520 00000100:00100000:3.0:1789607792.867185:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607792.867196:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150171520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607792.867242:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607792.867296:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150171520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607792.867304:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789607792.867329:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607792.867374:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150171520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607793.378745:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d790133f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150171648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607793.378886:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607793.379049:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607793.379058:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150171776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607793.379096:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607793.379138:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150171776 00000100:00100000:3.0:1789607793.379147:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150171776 00000100:00100000:3.0:1789607793.379224:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789607793.379236:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150171776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607793.379265:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607793.379315:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150171776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607793.379323:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789607793.379347:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607793.379607:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150171904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607793.379644:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607793.379666:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607793.379672:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150172032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607793.379707:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607793.379743:0:22574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150171648 00000100:00100000:0.0:1789607793.379748:0:22574:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150171648 00000100:00100000:0.0:1789607793.379778:0:22574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150172032 00000100:00100000:0.0:1789607793.379782:0:22574:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150172032 00000100:00100000:0.0:1789607793.379796:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789607793.379803:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150171648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607793.379843:0:22574:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607793.379897:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150171648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607793.379904:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789607793.379918:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789607793.379925:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150172032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789607793.379948:0:22574:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607793.379989:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150172032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607793.379996:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789607793.380037:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150172032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607793.380100:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150171904 00000100:00100000:0.0:1789607793.380105:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150171904 00000100:00100000:0.0:1789607793.380143:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607793.380151:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150171904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607793.380178:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607793.380221:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150171904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607793.380228:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789607793.380247:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607793.380262:0:3468:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1789607793.380278:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fcd82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150171904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607793.380492:0:3470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1789607793.380513:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150171776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607793.380533:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d790133f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150171648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607793.383822:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150172160:0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.383952:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607793.384011:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150172672:0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.384046:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607793.384070:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150173184:0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.384100:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607793.384130:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789607793.384137:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150172288:0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.384160:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607793.384179:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150172800:0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.384224:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607793.384259:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150172160 00000100:00100000:3.0:1789607793.384269:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150172160 00000100:00100000:3.0:1789607793.384325:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789607793.384337:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+24:3470:x1876539150172160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.384550:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+24:3470:x1876539150172160:12345-0@lo:400:kworker.0 Request processed in 214us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607793.384560:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789607793.384625:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150172160:0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.384696:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150172672 00000100:00100000:3.0:1789607793.384702:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150172672 00000100:00100000:3.0:1789607793.384725:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150173184 00000100:00100000:3.0:1789607793.384728:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150173184 00000100:00100000:3.0:1789607793.384754:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150172288 00000100:00100000:3.0:1789607793.384757:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150172288 00000100:00100000:3.0:1789607793.384769:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150172800 00000100:00100000:3.0:1789607793.384772:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150172800 00000100:00100000:3.0:1789607793.384788:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607793.384795:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150172672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.385518:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150172672:12345-0@lo:400:kworker.0 Request processed in 719us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607793.385529:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607793.385555:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789607793.385564:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150173184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.385596:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150173184:12345-0@lo:400:kworker.0 Request processed in 35us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607793.385602:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789607793.385632:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789607793.385639:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150172288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.385672:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150172288:12345-0@lo:400:kworker.0 Request processed in 34us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607793.385677:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789607793.385702:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789607793.385710:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150172800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.385737:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150172800:12345-0@lo:400:kworker.0 Request processed in 30us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607793.385743:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789607793.386107:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150172544:0@lo:400:kworker.0 00000100:00100000:0.0:1789607793.386159:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607793.386194:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150173056:0@lo:400:kworker.0 00000100:00100000:0.0:1789607793.386219:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607793.386243:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789607793.386251:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150172416:0@lo:400:kworker.0 00000100:00100000:0.0:1789607793.386276:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607793.386295:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150172928:0@lo:400:kworker.0 00000100:00100000:0.0:1789607793.386316:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607793.386344:0:23246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150172544 00000100:00100000:0.0:1789607793.386353:0:23246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150172544 00000100:00100000:0.0:1789607793.386928:0:23246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150172416 00000100:00100000:0.0:1789607793.386935:0:23246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150172416 00000100:00100000:0.0:1789607793.386972:0:23246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607793.386982:0:23246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150172544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607793.387061:0:23246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150172544:12345-0@lo:400:kworker.0 Request processed in 81us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607793.387069:0:23246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607793.387086:0:23246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607793.387094:0:23246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150172416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607793.387135:0:23246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150172416:12345-0@lo:400:kworker.0 Request processed in 42us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607793.387142:0:23246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607793.387180:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150173312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607793.387217:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789607793.387253:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607793.387259:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607793.387262:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607793.387320:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150172416:0@lo:400:kworker.0 00000100:00100000:0.0:1789607793.387333:0:3469:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1789607793.387349:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150172544:0@lo:400:kworker.0 00010000:00080000:2.0:1789607793.387961:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c624b800 x1876539150172288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607793.387990:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150172288:0@lo:400:kworker.0 00010000:00080000:2.0:1789607793.388006:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c624aa00 x1876539150172800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607793.388014:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150172800:0@lo:400:kworker.0 00010000:00080000:2.0:1789607793.388026:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c6249c00 x1876539150172672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607793.388034:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150172672:0@lo:400:kworker.0 00010000:00080000:2.0:1789607793.388045:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78fd114380 x1876539150173184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607793.388053:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fd114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150173184:0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.388762:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150173056 00000100:00100000:3.0:1789607793.388774:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150173056 00000100:00100000:3.0:1789607793.388847:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150172928 00000100:00100000:3.0:1789607793.388851:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150172928 00000100:00100000:3.0:1789607793.388889:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607793.388897:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f0701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150173056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.388986:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f0701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150173056:12345-0@lo:400:kworker.0 Request processed in 90us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607793.388993:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607793.389008:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789607793.389014:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150172928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.389045:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150172928:12345-0@lo:400:kworker.0 Request processed in 31us (2727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607793.389050:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789607793.389099:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607793.389103:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789607793.389130:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c6248380 x1876539150172928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607793.389156:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150172928:0@lo:400:kworker.0 00010000:00080000:3.0:1789607793.389182:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c6249180 x1876539150173056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607793.389190:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150173056:0@lo:400:kworker.0 00000100:00100000:3.0:1789607793.389298:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150173312 00000100:00100000:3.0:1789607793.389303:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150173312 00000100:00100000:3.0:1789607793.389331:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789607793.389338:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150173312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789607793.389358:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607793.391041:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150173312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1692us (3811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607793.391057:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607793.391230:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150173312:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789607793.570012:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607794.594341:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789607795.053264:0:21964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789607795.061038:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607795.063781:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130135296 00000100:00100000:1.0:1789607795.063802:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130135296 00000100:00100000:1.0:1789607795.064065:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 115 00000100:00100000:1.0:1789607795.064078:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2392:x1876539130135296:12345-192.168.203.25@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789607795.064116:0:21923:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c6585db7-cc05-4c19-a878-e5ff79e86fce@192.168.203.25@tcp t0 exp 0000000000000000 cur 700 last 0 00000020:00000080:1.0:1789607795.064187:0:21923:0:(genops.c:1384:class_connect()) connect: client c6585db7-cc05-4c19-a878-e5ff79e86fce, cookie 0xa26202d240fbf4e2 00000100:00080000:1.0:1789607795.064359:0:21923:0:(import.c:65:import_set_state_nolock()) ffff8d78fe028000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607795.064631:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+5:2392:x1876539130135296:12345-192.168.203.25@tcp:250:mount.lustre.0 Request processed in 553us (3606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607795.069745:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 115 00000100:00100000:2.0:1789607795.074814:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607795.074931:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130135424 00000100:00100000:1.0:1789607795.074944:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130135424 00000100:00100000:1.0:1789607795.075012:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00100000:1.0:1789607795.075027:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e0b48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+5:18349:x1876539130135424:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789607795.075051:0:21925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607795.075075:0:21925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c5bed000/0xa26202d240fbf4e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668e42 expref: -99 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607795.075113:0:21925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c5bed000/0xa26202d240fbf4e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e42 expref: 6 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607795.075153:0:21925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c5bed000/0xa26202d240fbf4e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e42 expref: 6 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607795.075176:0:21925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c5bed000, rc 0) 00000100:00100000:1.0:1789607795.075255:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e0b48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+6:18349:x1876539130135424:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 232us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607795.075263:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 116 00000100:00100000:0.0:1789607795.081684:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607795.082492:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130135552 00000100:00100000:1.0:1789607795.082507:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130135552 00000100:00100000:1.0:1789607795.082578:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:1.0:1789607795.082591:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+6:18349:x1876539130135552:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789607795.083811:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+6:18349:x1876539130135552:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 1213us (2143us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789607795.083933:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 117 00000100:00100000:2.0:1789607795.090813:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607795.091137:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130135680 00000100:00100000:3.0:1789607795.091153:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130135680 00000100:00100000:3.0:1789607795.091225:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00100000:3.0:1789607795.091237:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+6:18349:x1876539130135680:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789607795.091261:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607795.091286:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7900ef9600/0xa26202d240fbf4f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668e49 expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607795.091337:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef9600/0xa26202d240fbf4f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e49 expref: 7 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607795.091375:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7900ef9600/0xa26202d240fbf4f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e49 expref: 7 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607795.091386:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9600, rc 0) 00000100:00100000:3.0:1789607795.091469:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+7:18349:x1876539130135680:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 234us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607795.091476:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 118 00000100:00100000:2.0:1789607795.094831:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607795.094924:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130135808 00000100:00100000:1.0:1789607795.094938:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130135808 00000100:00100000:1.0:1789607795.095006:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 119 00000100:00100000:1.0:1789607795.095019:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+7:18349:x1876539130135808:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789607795.095647:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+8:18349:x1876539130135808:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 627us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607795.095657:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 119 00000100:00100000:1.0:1789607795.100521:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607795.101233:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130135936 00000100:00100000:0.0:1789607795.101248:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130135936 00000100:00100000:0.0:1789607795.101450:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 120 00000100:00100000:0.0:1789607795.101464:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+8:18349:x1876539130135936:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789607795.111446:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+8:18349:x1876539130135936:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 9966us (10917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607795.111495:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 120 00000100:00100000:2.0:1789607795.128533:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607795.129583:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130136064 00000100:00100000:1.0:1789607795.129601:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130136064 00000100:00100000:1.0:1789607795.129951:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 121 00000100:00100000:1.0:1789607795.129985:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+8:18367:x1876539130136064:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789607795.130501:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+8:18367:x1876539130136064:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 516us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607795.131603:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 121 00000100:00100000:1.0:1789607795.165933:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607795.166056:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130136192 00000100:00100000:0.0:1789607795.166069:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130136192 00000100:00100000:0.0:1789607795.166193:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 122 00000100:00100000:0.0:1789607795.166207:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+8:18367:x1876539130136192:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607795.166607:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+8:18367:x1876539130136192:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 402us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607795.166617:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 122 00000100:00100000:1.0:1789607795.177444:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607795.178931:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130136320 00000100:00100000:0.0:1789607795.178946:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130136320 00000100:00100000:0.0:1789607795.179013:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 123 00000100:00100000:0.0:1789607795.179024:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+8:18367:x1876539130136320:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607795.179274:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+8:18367:x1876539130136320:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 251us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607795.179282:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 123 00000100:00100000:3.0:1789607795.181956:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607795.182450:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130136448 00000100:00100000:0.0:1789607795.182460:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130136448 00000100:00100000:0.0:1789607795.182506:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 124 00000100:00100000:0.0:1789607795.182516:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+8:18349:x1876539130136448:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789607795.182533:0:21925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607795.182551:0:21925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d79018f1400/0xa26202d240fbf4f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668e7a expref: -99 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607795.182582:0:21925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d79018f1400/0xa26202d240fbf4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e7a expref: 9 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607795.182619:0:21925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d79018f1400/0xa26202d240fbf4f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e7a expref: 9 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607795.182628:0:21925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f1400, rc 0) 00000100:00100000:0.0:1789607795.182696:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+9:18349:x1876539130136448:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 180us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607795.182703:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 124 00000100:00100000:1.0:1789607795.190012:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607795.190409:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130136576 00000100:00100000:2.0:1789607795.190420:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130136576 00000100:00100000:2.0:1789607795.190476:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 125 00000100:00100000:2.0:1789607795.190486:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+9:18349:x1876539130136576:12345-192.168.203.25@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789607795.190510:0:21924:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789607795.190532:0:21924:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789607795.190537:0:21924:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789607795.190540:0:21924:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789607795.190549:0:21924:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789607795.190552:0:21924:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1789607795.194239:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+9:18349:x1876539130136576:12345-192.168.203.25@tcp:256:mount.lustre.0 Request processed in 3733us (4214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607795.194255:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 125 00000100:00100000:3.0:1789607795.203284:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607795.203750:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130136704 00000100:00100000:0.0:1789607795.203760:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130136704 00000100:00100000:0.0:1789607795.203816:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 126 00000100:00100000:0.0:1789607795.203826:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+9:18349:x1876539130136704:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789607795.203841:0:21925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607795.203858:0:21925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d79018f1e00/0xa26202d240fbf4fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668e81 expref: -99 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607795.204771:0:21925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d79018f1e00/0xa26202d240fbf4fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e81 expref: 10 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607795.204783:0:21925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d79018f1e00/0xa26202d240fbf4fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e81 expref: 10 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607795.204793:0:21925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f1e00, rc 0) 00000100:00100000:0.0:1789607795.204918:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+10:18349:x1876539130136704:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 1092us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607795.204926:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 126 00000100:00100000:1.0:1789607795.214245:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607795.214421:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130136832 00000100:00100000:2.0:1789607795.214432:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130136832 00000100:00100000:2.0:1789607795.214486:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 127 00000100:00100000:2.0:1789607795.214496:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfc9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+10:18349:x1876539130136832:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789607795.214786:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfc9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+10:18349:x1876539130136832:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 290us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607795.214795:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 127 00000100:00100000:2.0:1789607795.217298:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607795.217406:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130136960 00000100:00100000:1.0:1789607795.217415:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130136960 00000100:00100000:1.0:1789607795.217464:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 128 00000100:00100000:1.0:1789607795.217473:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f634a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+10:18349:x1876539130136960:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789607795.217916:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f634a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+10:18349:x1876539130136960:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 441us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607795.217924:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 128 00000100:00100000:3.0:1789607795.221770:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607795.221890:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130137088 00000100:00100000:0.0:1789607795.221912:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130137088 00000100:00100000:0.0:1789607795.221969:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 129 00000100:00100000:0.0:1789607795.221980:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+10:18371:x1876539130137088:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607795.222286:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+10:18371:x1876539130137088:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 308us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607795.222294:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 129 00000100:00100000:3.0:1789607795.236900:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607795.237066:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130137216 00000100:00100000:2.0:1789607795.237077:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130137216 00000100:00100000:2.0:1789607795.237123:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 130 00000100:00100000:2.0:1789607795.237133:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+10:18371:x1876539130137216:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607795.237396:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+10:18371:x1876539130137216:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 263us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607795.237404:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 130 00000100:00100000:3.0:1789607795.250961:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607795.251152:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130137344 00000100:00100000:0.0:1789607795.251163:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130137344 00000100:00100000:0.0:1789607795.251203:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:0.0:1789607795.251211:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1876539130137344:12345-192.168.203.25@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789607795.251239:0:21930:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b2194c24-0745-4580-b5e4-c0f06b3be2e9@192.168.203.25@tcp t0 exp 0000000000000000 cur 700 last 0 00000020:00000080:0.0:1789607795.251290:0:21930:0:(genops.c:1384:class_connect()) connect: client b2194c24-0745-4580-b5e4-c0f06b3be2e9, cookie 0xa26202d240fbf505 00000004:00100000:0.0:1789607795.251319:0:21930:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789607795.251705:0:21930:0:(import.c:65:import_set_state_nolock()) ffff8d78f849f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607795.251776:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:2392:x1876539130137344:12345-192.168.203.25@tcp:38:mount.lustre.0 Request processed in 564us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607795.251785:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:3.0:1789607795.254823:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607795.255154:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130137600 00000100:00100000:1.0:1789607795.255165:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130137600 00000100:00100000:1.0:1789607795.255213:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:1.0:1789607795.255222:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1876539130137600:12345-192.168.203.25@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789607795.255266:0:21931:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from b2194c24-0745-4580-b5e4-c0f06b3be2e9@192.168.203.25@tcp t0 exp 0000000000000000 cur 700 last 0 00000020:00000080:1.0:1789607795.255317:0:21931:0:(genops.c:1384:class_connect()) connect: client b2194c24-0745-4580-b5e4-c0f06b3be2e9, cookie 0xa26202d240fbf50c 00000004:00100000:1.0:1789607795.255346:0:21931:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789607795.255779:0:21931:0:(import.c:65:import_set_state_nolock()) ffff8d78fe02b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607795.256218:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:2392:x1876539130137600:12345-192.168.203.25@tcp:38:mount.lustre.0 Request processed in 994us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607795.256245:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:1.0:1789607795.257076:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607795.257635:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130137472 00000100:00100000:0.0:1789607795.257645:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130137472 00000100:00100000:0.0:1789607795.257733:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:0.0:1789607795.257744:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:0:x1876539130137472:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789607795.257787:0:21930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607795.257902:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:0:x1876539130137472:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 159us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607795.257909:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00080000:3.0:1789607795.257980:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607795.259089:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607795.259261:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130137856 00000100:00100000:1.0:1789607795.259269:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130137856 00000100:00100000:1.0:1789607795.259319:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:1.0:1789607795.259328:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:18349:x1876539130137856:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789607795.259513:0:21931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607795.259583:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:18349:x1876539130137856:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 256us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607795.259591:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:3.0:1789607795.264973:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607795.265111:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130137984 00000100:00100000:0.0:1789607795.265120:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130137984 00000100:00100000:0.0:1789607795.265169:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:0.0:1789607795.265178:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:18349:x1876539130137984:12345-192.168.203.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789607795.265260:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:18349:x1876539130137984:12345-192.168.203.25@tcp:40:mount.lustre.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607795.265267:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:3.0:1789607795.269381:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607795.269533:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130137728 00000100:00100000:1.0:1789607795.269542:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130137728 00000100:00100000:1.0:1789607795.269618:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00100000:1.0:1789607795.269628:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:0:x1876539130137728:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789607795.269695:0:23783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789607795.269788:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:0:x1876539130137728:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 161us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607795.269796:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 12 00000100:00080000:3.0:1789607795.270560:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607795.278706:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607795.278751:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607795.278778:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607795.278808:0:23246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130138112 00000100:00100000:3.0:1789607795.278818:0:23246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130138112 00000100:00100000:3.0:1789607795.278889:0:23246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130138368 00000100:00100000:3.0:1789607795.278893:0:23246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130138368 00000100:00100000:3.0:1789607795.278913:0:23246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1789607795.278921:0:23246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1876539130138112:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789607795.278959:0:23246:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b2194c24-0745-4580-b5e4-c0f06b3be2e9@192.168.203.25@tcp t0 exp 0000000000000000 cur 700 last 0 00000020:00000080:3.0:1789607795.279005:0:23246:0:(genops.c:1384:class_connect()) connect: client b2194c24-0745-4580-b5e4-c0f06b3be2e9, cookie 0xa26202d240fbf513 00002000:00100000:3.0:1789607795.279019:0:23246:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b2194c24-0745-4580-b5e4-c0f06b3be2e9/ffff8d77c40df000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789607795.279047:0:23246:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789607795.280735:0:23244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:1.0:1789607795.280748:0:23244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876539130138368:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789607795.280786:0:23244:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b2194c24-0745-4580-b5e4-c0f06b3be2e9@192.168.203.25@tcp t0 exp 0000000000000000 cur 700 last 0 00000020:00000080:1.0:1789607795.280818:0:23244:0:(genops.c:1384:class_connect()) connect: client b2194c24-0745-4580-b5e4-c0f06b3be2e9, cookie 0xa26202d240fbf51a 00002000:00100000:1.0:1789607795.280829:0:23244:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b2194c24-0745-4580-b5e4-c0f06b3be2e9/ffff8d78fe02f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789607795.280890:0:23244:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789607795.281209:0:23244:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789607795.281249:0:23244:0:(import.c:65:import_set_state_nolock()) ffff8d78fe029000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607795.281331:0:23244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:2392:x1876539130138368:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 583us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607795.281340:0:23244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:0.0:1789607795.282183:0:21941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130138496 00000100:00100000:0.0:1789607795.282193:0:21941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130138496 00000100:00100000:0.0:1789607795.282228:0:21941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:0.0:1789607795.282236:0:21941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:18349:x1876539130138496:12345-192.168.203.25@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789607795.282278:0:21941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:18349:x1876539130138496:12345-192.168.203.25@tcp:900:mount.lustre.0 Request processed in 43us (3584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607795.282284:0:21941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00002000:00080000:3.0:1789607795.282530:0:23246:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789607795.282554:0:23246:0:(import.c:65:import_set_state_nolock()) ffff8d77c40d8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607795.282582:0:23246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:2392:x1876539130138112:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 3660us (3830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607795.282589:0:23246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:3.0:1789607795.283775:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607795.284383:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130138240 00000100:00100000:0.0:1789607795.284392:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130138240 00000100:00100000:0.0:1789607795.284436:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 131 00000100:00100000:0.0:1789607795.284444:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+10:2394:x1876539130138240:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607795.284503:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+10:2394:x1876539130138240:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 61us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607795.284510:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 131 00000100:00100000:1.0:1789607795.290045:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607795.290159:0:21933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130138624 00000100:00100000:2.0:1789607795.290170:0:21933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130138624 00000100:00100000:2.0:1789607795.290213:0:21933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:2.0:1789607795.290222:0:21933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:18349:x1876539130138624:12345-192.168.203.25@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789607795.295900:0:21933:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5599us 00000004:00200000:3.0:1789607795.311171:0:21933:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789607795.311296:0:21933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:18349:x1876539130138624:12345-192.168.203.25@tcp:33:mount.lustre.0 Request processed in 21070us (21256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607795.311311:0:21933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000001:00100000:2.0:1789607795.495474:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b2194c24-0745-4580-b5e4-c0f06b3be2e9 00000100:00100000:1.0:1789607795.532956:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607795.533030:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130138752 00000100:00100000:0.0:1789607795.533041:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130138752 00000100:00100000:0.0:1789607795.533100:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:0.0:1789607795.533111:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:18394:x1876539130138752:12345-192.168.203.25@tcp:101:mkdir.0 00010000:00010000:0.0:1789607795.533132:0:21930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607795.533167:0:21930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1600/0xa26202d240fbf521 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668eb2 expref: -99 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607795.533231:0:21930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1800/0xa26202d240fbf528 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607795.533244:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1800/0xa26202d240fbf528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607795.533257:0:21930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1800/0xa26202d240fbf528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607795.533296:0:21930:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789607795.533300:0:21930:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607795.533335:0:21930:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1800/0xa26202d240fbf528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607795.533360:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1600/0xa26202d240fbf521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668eb2 expref: 8 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607795.533380:0:21930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1800/0xa26202d240fbf528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668eb2 expref: 7 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607795.533387:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:0.0:1789607795.533390:0:21930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607795.533393:0:21930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f1800, rc 0) 00000100:00100000:0.0:1789607795.533457:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:18394:x1876539130138752:12345-192.168.203.25@tcp:101:mkdir.0 Request processed in 347us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607795.533465:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00010000:00010000:0.0:1789607795.620074:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789607796.011899:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b2194c24-0745-4580-b5e4-c0f06b3be2e9 00010000:00010000:2.0:1789607796.646724:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607797.666693:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607797.747380:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607797.748592:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130138880 00000100:00100000:1.0:1789607797.748618:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130138880 00000100:00100000:1.0:1789607797.748712:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:1.0:1789607797.748725:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cfface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:18447:x1876539130138880:12345-192.168.203.25@tcp:41:lfs.0 00000100:00080000:3.0:1789607797.748756:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1789607797.748770:0:23783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607797.748885:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cfface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:18447:x1876539130138880:12345-192.168.203.25@tcp:41:lfs.0 Request processed in 162us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607797.748892:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:2.0:1789607797.752432:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607797.752534:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130139008 00000100:00100000:0.0:1789607797.752544:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130139008 00000100:00100000:0.0:1789607797.752640:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00100000:0.0:1789607797.752652:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:18447:x1876539130139008:12345-192.168.203.25@tcp:41:lfs.0 00000004:00000024:0.0:1789607797.752705:0:21930:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607797.752814:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:18447:x1876539130139008:12345-192.168.203.25@tcp:41:lfs.0 Request processed in 164us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607797.752822:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00080000:3.0:1789607797.753234:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607797.760311:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607797.760386:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130139136 00000100:00100000:3.0:1789607797.760395:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130139136 00000100:00100000:3.0:1789607797.760466:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:3.0:1789607797.760476:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:18447:x1876539130139136:12345-192.168.203.25@tcp:13:lfs.0 00002000:00000024:3.0:1789607797.760517:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789607797.760940:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607797.760991:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:18447:x1876539130139136:12345-192.168.203.25@tcp:13:lfs.0 Request processed in 516us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607797.761000:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:2.0:1789607797.775850:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607797.776033:0:23249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130139264 00000100:00100000:1.0:1789607797.776043:0:23249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130139264 00000100:00100000:1.0:1789607797.776109:0:23249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:1.0:1789607797.776119:0:23249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:18447:x1876539130139264:12345-192.168.203.25@tcp:13:lfs.0 00002000:00000024:1.0:1789607797.776157:0:23249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607797.776243:0:23249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:18447:x1876539130139264:12345-192.168.203.25@tcp:13:lfs.0 Request processed in 125us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607797.776250:0:23249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00080000:0.0:1789607797.777276:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607797.975226:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607797.975319:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130139392 00000100:00100000:0.0:1789607797.975330:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130139392 00000100:00100000:0.0:1789607797.975388:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 132 00000100:00100000:0.0:1789607797.975400:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+10:18479:x1876539130139392:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789607797.975427:0:21925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607797.975447:0:21925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d79018f1000/0xa26202d240fbf52f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668eb9 expref: -99 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607797.975479:0:21925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d79018f1000/0xa26202d240fbf52f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668eb9 expref: 11 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607797.975492:0:21925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d79018f1000/0xa26202d240fbf52f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668eb9 expref: 11 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607797.975500:0:21925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f1000, rc 0) 00000100:00100000:0.0:1789607797.975561:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:18479:x1876539130139392:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 163us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607797.975582:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 132 00000100:00100000:1.0:1789607797.986982:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607797.987011:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150173440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789607797.987087:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607797.987213:0:23249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150173440 00000100:00100000:3.0:1789607797.987221:0:23249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150173440 00000100:00100000:3.0:1789607797.987306:0:23249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607797.987315:0:23249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150173440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789607797.987339:0:23249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607797.987396:0:23249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150173440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607797.987402:0:23249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607797.987465:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150173440:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789607797.987649:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607797.992722:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607797.992825:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130139520 00000100:00100000:3.0:1789607797.992835:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130139520 00000100:00100000:3.0:1789607797.992918:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 133 00000100:00100000:3.0:1789607797.992929:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:18479:x1876539130139520:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789607797.993214:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:18479:x1876539130139520:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 286us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607797.993223:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 133 00000100:00100000:2.0:1789607797.997089:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607797.997183:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130139648 00000100:00100000:1.0:1789607797.997193:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130139648 00000100:00100000:1.0:1789607797.997254:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 134 00000100:00100000:1.0:1789607797.997264:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:18479:x1876539130139648:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789607797.997479:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:18479:x1876539130139648:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 215us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607797.997487:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 134 00000100:00100000:2.0:1789607798.012538:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607798.013196:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130139776 00000100:00100000:0.0:1789607798.013206:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130139776 00000100:00100000:0.0:1789607798.013257:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 135 00000100:00100000:0.0:1789607798.013266:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:18486:x1876539130139776:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607798.013531:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:18486:x1876539130139776:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 264us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607798.013538:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 135 00000100:00100000:2.0:1789607798.066108:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607798.066322:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130139904 00000100:00100000:3.0:1789607798.066335:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130139904 00000100:00100000:3.0:1789607798.066406:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 136 00000100:00100000:3.0:1789607798.066420:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:18486:x1876539130139904:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789607798.067006:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:18486:x1876539130139904:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 587us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.067016:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 136 00000100:00100000:2.0:1789607798.074202:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607798.074505:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130140032 00000100:00100000:1.0:1789607798.074520:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130140032 00000100:00100000:1.0:1789607798.074594:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 137 00000100:00100000:1.0:1789607798.074612:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:18486:x1876539130140032:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789607798.074907:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:18486:x1876539130140032:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 302us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607798.074915:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 137 00000100:00100000:2.0:1789607798.078588:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607798.079122:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130140160 00000100:00100000:3.0:1789607798.079136:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130140160 00000100:00100000:3.0:1789607798.079214:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 138 00000100:00100000:3.0:1789607798.079225:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:18479:x1876539130140160:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789607798.079248:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607798.079287:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7900ef8600/0xa26202d240fbf536 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668eea expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607798.079325:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef8600/0xa26202d240fbf536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668eea expref: 12 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607798.079339:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7900ef8600/0xa26202d240fbf536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668eea expref: 12 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607798.079349:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8600, rc 0) 00000100:00100000:3.0:1789607798.079419:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+12:18479:x1876539130140160:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 196us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.079426:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 138 00000100:00100000:2.0:1789607798.088211:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607798.088473:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130140288 00000100:00100000:0.0:1789607798.088487:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130140288 00000100:00100000:0.0:1789607798.088562:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 139 00000100:00100000:0.0:1789607798.088574:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+12:18479:x1876539130140288:12345-192.168.203.25@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789607798.088610:0:21925:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789607798.088660:0:21925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789607798.088665:0:21925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789607798.088669:0:21925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789607798.088672:0:21925:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789607798.088674:0:21925:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1789607798.094175:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+12:18479:x1876539130140288:12345-192.168.203.25@tcp:256:mount.lustre.0 Request processed in 5587us (5962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607798.094193:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 139 00000100:00100000:2.0:1789607798.098409:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607798.098896:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130140416 00000100:00100000:1.0:1789607798.098920:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130140416 00000100:00100000:1.0:1789607798.098996:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 140 00000100:00100000:1.0:1789607798.099009:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+12:18479:x1876539130140416:12345-192.168.203.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789607798.099031:0:21923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607798.099060:0:21923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c5bec200/0xa26202d240fbf53d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668ef1 expref: -99 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607798.099103:0:21923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c5bec200/0xa26202d240fbf53d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ef1 expref: 13 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607798.099137:0:21923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c5bec200/0xa26202d240fbf53d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ef1 expref: 13 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607798.099148:0:21923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c5bec200, rc 0) 00000100:00100000:1.0:1789607798.099230:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18479:x1876539130140416:12345-192.168.203.25@tcp:101:mount.lustre.0 Request processed in 224us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607798.099238:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 140 00000100:00100000:2.0:1789607798.111641:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607798.112378:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130140544 00000100:00100000:0.0:1789607798.112394:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130140544 00000100:00100000:0.0:1789607798.112468:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 141 00000100:00100000:0.0:1789607798.112479:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18479:x1876539130140544:12345-192.168.203.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789607798.114318:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18479:x1876539130140544:12345-192.168.203.25@tcp:501:mount.lustre.0 Request processed in 1828us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607798.114336:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 141 00000100:00100000:2.0:1789607798.120311:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607798.120397:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130140672 00000100:00100000:3.0:1789607798.120410:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130140672 00000100:00100000:3.0:1789607798.120474:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 142 00000100:00100000:3.0:1789607798.120485:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18479:x1876539130140672:12345-192.168.203.25@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789607798.120778:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18479:x1876539130140672:12345-192.168.203.25@tcp:503:mount.lustre.0 Request processed in 294us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.120786:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 142 00000100:00100000:2.0:1789607798.127688:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607798.127813:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130140800 00000100:00100000:1.0:1789607798.127826:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130140800 00000100:00100000:1.0:1789607798.127934:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 143 00000100:00100000:1.0:1789607798.127946:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f63e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18492:x1876539130140800:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789607798.128481:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f63e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18492:x1876539130140800:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 534us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607798.128492:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 143 00000100:00100000:2.0:1789607798.135005:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607798.135125:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130140928 00000100:00100000:0.0:1789607798.135140:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130140928 00000100:00100000:0.0:1789607798.135221:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 144 00000100:00100000:0.0:1789607798.135233:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18492:x1876539130140928:12345-192.168.203.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607798.135583:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18492:x1876539130140928:12345-192.168.203.25@tcp:502:llog_process_th.0 Request processed in 350us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607798.135593:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 144 00000100:00100000:2.0:1789607798.151234:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607798.151293:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607798.151592:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130141056 00000100:00100000:1.0:1789607798.151606:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130141056 00000100:00100000:1.0:1789607798.151674:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130141312 00000100:00100000:1.0:1789607798.151677:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130141312 00000100:00100000:1.0:1789607798.151709:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:1.0:1789607798.151720:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1876539130141056:12345-192.168.203.25@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789607798.151760:0:23783:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f84cf179-1248-41a2-8641-5e45322bb8df@192.168.203.25@tcp t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:1.0:1789607798.151825:0:23783:0:(genops.c:1384:class_connect()) connect: client f84cf179-1248-41a2-8641-5e45322bb8df, cookie 0xa26202d240fbf544 00000004:00100000:1.0:1789607798.151905:0:23783:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789607798.152114:0:23783:0:(import.c:65:import_set_state_nolock()) ffff8d78c6e7a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607798.152216:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84cf179-1248-41a2-8641-5e45322bb8df+6:2392:x1876539130141056:12345-192.168.203.25@tcp:38:mount.lustre.0 Request processed in 496us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607798.152233:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:1.0:1789607798.152258:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:1.0:1789607798.152264:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1876539130141312:12345-192.168.203.25@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789607798.152283:0:23783:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from f84cf179-1248-41a2-8641-5e45322bb8df@192.168.203.25@tcp t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:1.0:1789607798.152313:0:23783:0:(genops.c:1384:class_connect()) connect: client f84cf179-1248-41a2-8641-5e45322bb8df, cookie 0xa26202d240fbf54b 00000004:00100000:1.0:1789607798.152332:0:23783:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789607798.152397:0:23783:0:(import.c:65:import_set_state_nolock()) ffff8d78c6e7f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607798.152425:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84cf179-1248-41a2-8641-5e45322bb8df+6:2392:x1876539130141312:12345-192.168.203.25@tcp:38:mount.lustre.0 Request processed in 159us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607798.152432:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:2.0:1789607798.156553:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607798.156597:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607798.156643:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607798.156821:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130141568 00000100:00100000:0.0:1789607798.156834:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130141568 00000100:00100000:0.0:1789607798.156942:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130141440 00000100:00100000:0.0:1789607798.156946:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130141440 00000100:00100000:0.0:1789607798.156962:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130141184 00000100:00100000:0.0:1789607798.156965:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130141184 00000100:00100000:0.0:1789607798.156981:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:0.0:1789607798.156992:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84cf179-1248-41a2-8641-5e45322bb8df+7:18479:x1876539130141568:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789607798.157055:0:21931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607798.157143:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84cf179-1248-41a2-8641-5e45322bb8df+7:18479:x1876539130141568:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 151us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607798.157150:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:0.0:1789607798.157170:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:0.0:1789607798.157176:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84cf179-1248-41a2-8641-5e45322bb8df+6:0:x1876539130141440:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789607798.157199:0:21931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607798.157250:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84cf179-1248-41a2-8641-5e45322bb8df+6:0:x1876539130141440:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 74us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607798.157257:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:0.0:1789607798.157270:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:0.0:1789607798.157277:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84cf179-1248-41a2-8641-5e45322bb8df+6:0:x1876539130141184:12345-192.168.203.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789607798.157287:0:21931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607798.157309:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84cf179-1248-41a2-8641-5e45322bb8df+6:0:x1876539130141184:12345-192.168.203.25@tcp:41:mount.lustre.0 Request processed in 33us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607798.157316:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00080000:0.0:1789607798.157340:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789607798.157343:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607798.166711:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607798.167005:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130141696 00000100:00100000:0.0:1789607798.167019:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130141696 00000100:00100000:0.0:1789607798.167108:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:0.0:1789607798.167121:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84cf179-1248-41a2-8641-5e45322bb8df+6:18479:x1876539130141696:12345-192.168.203.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789607798.167250:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84cf179-1248-41a2-8641-5e45322bb8df+6:18479:x1876539130141696:12345-192.168.203.25@tcp:40:mount.lustre.0 Request processed in 131us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607798.167258:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:2.0:1789607798.179452:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607798.179500:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607798.179547:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607798.179641:0:23244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130141824 00000100:00100000:3.0:1789607798.179661:0:23244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130141824 00000100:00100000:3.0:1789607798.179717:0:23244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130141952 00000100:00100000:3.0:1789607798.179721:0:23244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130141952 00000100:00100000:3.0:1789607798.179758:0:23244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:3.0:1789607798.179769:0:23244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876539130141824:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789607798.179820:0:23244:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f84cf179-1248-41a2-8641-5e45322bb8df@192.168.203.25@tcp t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:3.0:1789607798.179892:0:23244:0:(genops.c:1384:class_connect()) connect: client f84cf179-1248-41a2-8641-5e45322bb8df, cookie 0xa26202d240fbf552 00002000:00100000:3.0:1789607798.179937:0:23244:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f84cf179-1248-41a2-8641-5e45322bb8df/ffff8d77c40df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789607798.179953:0:23244:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789607798.180183:0:23244:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789607798.180230:0:23244:0:(import.c:65:import_set_state_nolock()) ffff8d77c40d9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607798.180330:0:23244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f84cf179-1248-41a2-8641-5e45322bb8df+6:2392:x1876539130141824:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 560us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.180340:0:23244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:3.0:1789607798.180363:0:23244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:3.0:1789607798.180369:0:23244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1876539130141952:12345-192.168.203.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789607798.180389:0:23244:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f84cf179-1248-41a2-8641-5e45322bb8df@192.168.203.25@tcp t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:3.0:1789607798.180408:0:23244:0:(genops.c:1384:class_connect()) connect: client f84cf179-1248-41a2-8641-5e45322bb8df, cookie 0xa26202d240fbf559 00002000:00100000:3.0:1789607798.180414:0:23244:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f84cf179-1248-41a2-8641-5e45322bb8df/ffff8d77c40dc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789607798.180422:0:23244:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789607798.180530:0:23244:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789607798.180549:0:23244:0:(import.c:65:import_set_state_nolock()) ffff8d77c40dd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607798.180575:0:23244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f84cf179-1248-41a2-8641-5e45322bb8df+6:2392:x1876539130141952:12345-192.168.203.25@tcp:8:mount.lustre.0 Request processed in 204us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.180582:0:23244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:0.0:1789607798.180887:0:21941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130142080 00000100:00100000:0.0:1789607798.180894:0:21941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130142080 00000100:00100000:0.0:1789607798.180958:0:21941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:0.0:1789607798.180967:0:21941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c61ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f84cf179-1248-41a2-8641-5e45322bb8df+6:18479:x1876539130142080:12345-192.168.203.25@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789607798.181011:0:21941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c61ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f84cf179-1248-41a2-8641-5e45322bb8df+6:18479:x1876539130142080:12345-192.168.203.25@tcp:900:mount.lustre.0 Request processed in 46us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607798.181018:0:21941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:1.0:1789607798.189444:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607798.190800:0:21934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130142208 00000100:00100000:0.0:1789607798.190821:0:21934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130142208 00000100:00100000:0.0:1789607798.190950:0:21934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:0.0:1789607798.190964:0:21934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84cf179-1248-41a2-8641-5e45322bb8df+6:18479:x1876539130142208:12345-192.168.203.25@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789607798.191071:0:21934:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789607798.191191:0:21934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84cf179-1248-41a2-8641-5e45322bb8df+6:18479:x1876539130142208:12345-192.168.203.25@tcp:33:mount.lustre.0 Request processed in 230us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607798.191199:0:21934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:1.0:1789607798.410283:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607798.410490:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130142336 00000100:00100000:0.0:1789607798.410502:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130142336 00000100:00100000:0.0:1789607798.410572:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:0.0:1789607798.410581:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84cf179-1248-41a2-8641-5e45322bb8df+6:18515:x1876539130142336:12345-192.168.203.25@tcp:101:mkdir.0 00010000:00010000:0.0:1789607798.410607:0:21930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607798.410632:0:21930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1200/0xa26202d240fbf560 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f22 expref: -99 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607798.410721:0:21930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf567 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607798.410736:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607798.410750:0:21930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607798.410792:0:21930:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789607798.410796:0:21930:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607798.410814:0:21930:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf567 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607798.410900:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1200/0xa26202d240fbf560 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f22 expref: 8 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607798.410928:0:21930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f22 expref: 7 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607798.410938:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:0.0:1789607798.410941:0:21930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607798.410945:0:21930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f0c00, rc 0) 00000100:00100000:0.0:1789607798.411128:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84cf179-1248-41a2-8641-5e45322bb8df+7:18515:x1876539130142336:12345-192.168.203.25@tcp:101:mkdir.0 Request processed in 547us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607798.411136:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 22 00000100:00100000:1.0:1789607798.498292:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607798.498325:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150173568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607798.498424:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607798.498521:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150173568 00000100:00100000:1.0:1789607798.498532:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150173568 00000100:00100000:1.0:1789607798.498613:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607798.498625:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150173568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607798.498666:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607798.498718:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150173568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607798.498727:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607798.498785:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150173568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607798.498832:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150173952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607798.498889:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607798.498926:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150173952 00000100:00100000:1.0:1789607798.498930:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150173952 00000100:00100000:1.0:1789607798.498960:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789607798.498968:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150173952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607798.498982:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607798.499023:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150173952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607798.499030:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789607798.499065:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150173952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607798.499155:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150173824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607798.499194:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607798.499224:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607798.499231:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150173696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607798.499255:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607798.499497:0:22574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150173824 00000100:00100000:0.0:1789607798.499502:0:22574:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150173824 00000100:00100000:0.0:1789607798.499536:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789607798.499543:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150173824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607798.499567:0:22574:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607798.499610:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150173824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607798.499617:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789607798.499659:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607798.499665:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607798.499689:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150173824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789607798.506207:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150174208:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.506313:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607798.506363:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150174720:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.506397:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607798.506419:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150175232:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.506441:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607798.506499:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789607798.506506:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150174336:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.506529:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607798.506545:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150174848:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.506564:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607798.506596:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150174720 00000100:00100000:3.0:1789607798.506606:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150174720 00000100:00100000:3.0:1789607798.506663:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150175232 00000100:00100000:3.0:1789607798.506666:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150175232 00000100:00100000:3.0:1789607798.506694:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150174336 00000100:00100000:3.0:1789607798.506697:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150174336 00000100:00100000:3.0:1789607798.506710:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150174848 00000100:00100000:3.0:1789607798.506712:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150174848 00000100:00100000:3.0:1789607798.506730:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607798.506739:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c624b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150174720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.506800:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c624b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3470:x1876539150174720:12345-0@lo:400:kworker.0 Request processed in 62us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.506808:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607798.506830:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789607798.506836:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150175232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.506894:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3470:x1876539150175232:12345-0@lo:400:kworker.0 Request processed in 59us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.506900:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789607798.506912:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789607798.506918:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150174336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.506946:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3470:x1876539150174336:12345-0@lo:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.506962:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789607798.506975:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789607798.506981:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150174848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507009:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3470:x1876539150174848:12345-0@lo:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.507015:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789607798.507031:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607798.507036:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607798.507058:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150174080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607798.507090:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607798.507123:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150174592:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507148:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607798.507167:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150175104:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507188:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607798.507205:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789607798.507212:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150174464:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507232:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607798.507250:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150174976:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507269:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607798.507290:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150174080 00000100:00100000:3.0:1789607798.507293:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150174080 00000100:00100000:3.0:1789607798.507319:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150174464 00000100:00100000:3.0:1789607798.507322:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150174464 00000100:00100000:3.0:1789607798.507333:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607798.507338:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d790133f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539150174080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607798.507372:0:21936:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607798.507413:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d790133f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3469:x1876539150174080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.507420:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607798.507433:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789607798.507438:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150174464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507463:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150174464:12345-0@lo:400:kworker.0 Request processed in 25us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.507469:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789607798.507488:0:23852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150174592 00000100:00100000:3.0:1789607798.507492:0:23852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150174592 00000100:00100000:3.0:1789607798.507520:0:23852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607798.507526:0:23852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150174592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507556:0:23852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150174592:12345-0@lo:400:kworker.0 Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.507561:0:23852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607798.507615:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3470:1876539150174336:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507628:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3470:1876539150174848:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507640:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3470:1876539150174720:0@lo:400:kworker.0 00010000:00080000:3.0:1789607798.507665:0:3470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c624aa00 x1876539150175232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607798.507677:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c624aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3470:1876539150175232:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507711:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150175104 00000100:00100000:3.0:1789607798.507714:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150175104 00000100:00100000:3.0:1789607798.507746:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150174976 00000100:00100000:3.0:1789607798.507749:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150174976 00000100:00100000:3.0:1789607798.507764:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789607798.507770:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150175104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507801:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3469:x1876539150175104:12345-0@lo:400:kworker.0 Request processed in 31us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.507807:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789607798.507818:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607798.507824:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150174976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507852:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150174976:12345-0@lo:400:kworker.0 Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.507857:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789607798.507900:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607798.507904:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607798.507921:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150174464:0@lo:400:kworker.0 00010000:00080000:3.0:1789607798.507933:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78c6248380 x1876539150174976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607798.507943:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150174976:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507958:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150174080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607798.507968:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150174592:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.507978:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3469:1876539150175104:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.508049:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150174208 00000100:00100000:3.0:1789607798.508054:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150174208 00000100:00100000:3.0:1789607798.508085:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789607798.508092:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+24:3470:x1876539150174208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.508136:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+24:3470:x1876539150174208:12345-0@lo:400:kworker.0 Request processed in 45us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.508143:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789607798.508179:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150174208:0@lo:400:kworker.0 00000100:00100000:3.0:1789607798.508242:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150173696 00000100:00100000:3.0:1789607798.508247:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150173696 00000100:00100000:3.0:1789607798.508281:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607798.508287:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150173696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789607798.508303:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607798.508341:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150173696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (9085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607798.508347:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607798.508389:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150173696:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789607798.508405:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1789607798.549969:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f84cf179-1248-41a2-8641-5e45322bb8df 00000001:00100000:1.0:1789607798.549987:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b2194c24-0745-4580-b5e4-c0f06b3be2e9 00000001:00100000:3.0:1789607798.580644:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b2194c24-0745-4580-b5e4-c0f06b3be2e9 00000001:00100000:3.0:1789607798.580676:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f84cf179-1248-41a2-8641-5e45322bb8df 00010000:00010000:0.0:1789607798.690500:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607799.718004:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789607800.483035:0:22590:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1789607800.637549:0:9077:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f84cf179-1248-41a2-8641-5e45322bb8df 00010000:00010000:1.0:1789607800.744471:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789607801.134829:0:8140:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f84cf179-1248-41a2-8641-5e45322bb8df 00010000:00010000:0.0:1789607801.765619:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789607801.838709:0:24536:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789607802.786114:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607803.108584:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150175360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789607803.108664:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607803.108738:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150175360 00000100:00100000:2.0:1789607803.108745:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150175360 00000100:00100000:2.0:1789607803.108794:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789607803.108803:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150175360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789607803.108838:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607803.108905:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150175360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607803.108911:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789607803.108931:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607803.108965:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150175360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607803.400098:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607803.400168:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607803.400200:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607803.400230:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607803.400245:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607803.400260:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607803.400276:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607803.400304:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607803.400323:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607803.400345:0:23245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130142976 00000100:00100000:3.0:1789607803.400353:0:23245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130142976 00000100:00100000:3.0:1789607803.400401:0:23245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130143488 00000100:00100000:3.0:1789607803.400404:0:23245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130143488 00000100:00100000:3.0:1789607803.400417:0:23245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130142848 00000100:00100000:3.0:1789607803.400420:0:23245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130142848 00000100:00100000:3.0:1789607803.400432:0:23245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130143360 00000100:00100000:3.0:1789607803.400434:0:23245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130143360 00000100:00100000:3.0:1789607803.400449:0:23245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:3.0:1789607803.400458:0:23245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:2396:x1876539130142976:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607803.400496:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130142720 00000100:00100000:0.0:1789607803.400502:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130142720 00000100:00100000:3.0:1789607803.400525:0:23245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:2396:x1876539130142976:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 67us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607803.400532:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130143232 00000100:00100000:3.0:1789607803.400536:0:23245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:0.0:1789607803.400537:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130143232 00000100:00100000:3.0:1789607803.400562:0:23245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:0.0:1789607803.400562:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130142592 00000100:00100000:0.0:1789607803.400568:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130142592 00000100:00100000:3.0:1789607803.400573:0:23245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f84cf179-1248-41a2-8641-5e45322bb8df+5:2396:x1876539130143488:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607803.400587:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130143104 00000100:00100000:0.0:1789607803.400592:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130143104 00000100:00100000:3.0:1789607803.400602:0:23245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f84cf179-1248-41a2-8641-5e45322bb8df+5:2396:x1876539130143488:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607803.400608:0:23245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:3.0:1789607803.400631:0:23245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:3.0:1789607803.400638:0:23245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:2396:x1876539130142848:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607803.400660:0:23245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:2396:x1876539130142848:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 23us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607803.400666:0:23245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:3.0:1789607803.400677:0:23245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:3.0:1789607803.400690:0:23245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f84cf179-1248-41a2-8641-5e45322bb8df+5:2396:x1876539130143360:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607803.400716:0:23245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f84cf179-1248-41a2-8641-5e45322bb8df+5:2396:x1876539130143360:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607803.400722:0:23245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:3.0:1789607803.400742:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:3.0:1789607803.400748:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:2396:x1876539130142720:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607803.400774:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:2396:x1876539130142720:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607803.400779:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:3.0:1789607803.400792:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:3.0:1789607803.400798:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84cf179-1248-41a2-8641-5e45322bb8df+5:2396:x1876539130143232:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607803.400820:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f84cf179-1248-41a2-8641-5e45322bb8df+5:2396:x1876539130143232:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 22us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607803.400826:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:3.0:1789607803.400838:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:3.0:1789607803.400844:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:2396:x1876539130142592:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:3.0:1789607803.400889:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:2396:x1876539130142592:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 45us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607803.400895:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00080000:3.0:1789607803.400923:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607803.400927:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789607803.400930:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607803.400932:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607803.402171:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:0.0:1789607803.402182:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84cf179-1248-41a2-8641-5e45322bb8df+6:2396:x1876539130143104:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:0.0:1789607803.402368:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f84cf179-1248-41a2-8641-5e45322bb8df+6:2396:x1876539130143104:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 187us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607803.402376:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:1.0:1789607803.403411:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130142464 00000100:00100000:1.0:1789607803.403423:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130142464 00000100:00100000:1.0:1789607803.403478:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 146 00000100:00100000:1.0:1789607803.403487:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:2396:x1876539130142464:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607803.403538:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:2396:x1876539130142464:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 52us (3450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607803.403544:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 146 00000100:00080000:3.0:1789607803.404781:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607803.618018:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150175488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789607803.618051:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150175744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607803.618081:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607803.618084:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150175872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607803.618120:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607803.618142:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150176000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789607803.618158:0:23249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150175488 00000100:00100000:1.0:1789607803.618165:0:23249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150175488 00000100:00100000:3.0:1789607803.618168:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607803.618197:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607803.618204:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150175616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607803.618209:0:23249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150175872 00000100:00100000:1.0:1789607803.618212:0:23249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150175872 00000100:00100000:3.0:1789607803.618229:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607803.618233:0:23249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789607803.618243:0:23249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150175488:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789607803.618262:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150176000 00000100:00100000:3.0:1789607803.618265:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150176000 00000100:00100000:3.0:1789607803.618293:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150175616 00000100:00100000:3.0:1789607803.618296:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150175616 00000100:00100000:3.0:1789607803.618313:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789607803.618320:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150176000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789607803.618349:0:21936:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789607803.618399:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150176000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607803.618405:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789607803.618423:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607803.618429:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150175616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789607803.618446:0:21936:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607803.618494:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150175616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607803.618500:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607803.618552:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150175616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789607803.618563:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150176000:0@lo:41:osp-pre-1-0.0 00002000:00000024:1.0:1789607803.618696:0:23249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607803.618733:0:23249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150175488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 492us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607803.618739:0:23249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789607803.618753:0:23249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789607803.618759:0:23249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150175872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607803.618769:0:23249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607803.618805:0:23249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150175872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607803.618811:0:23249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789607803.618826:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607803.618837:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607803.618880:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150175872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607803.618885:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150175488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607803.619183:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150176384:0@lo:400:kworker.0 00000100:00100000:0.0:1789607803.619218:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607803.619275:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150176896:0@lo:400:kworker.0 00000100:00100000:0.0:1789607803.619298:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607803.619318:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789607803.619324:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150176256:0@lo:400:kworker.0 00000100:00100000:0.0:1789607803.619345:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607803.619362:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150176768:0@lo:400:kworker.0 00000100:00100000:0.0:1789607803.619391:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607803.619418:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150176384 00000100:00100000:0.0:1789607803.619423:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150176384 00000100:00100000:0.0:1789607803.619447:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150176896 00000100:00100000:0.0:1789607803.619450:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150176896 00000100:00100000:0.0:1789607803.619467:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150176256 00000100:00100000:0.0:1789607803.619468:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150176256 00000100:00100000:0.0:1789607803.619476:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150176768 00000100:00100000:0.0:1789607803.619478:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150176768 00000100:00100000:0.0:1789607803.619491:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789607803.619498:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150176384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607803.619506:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77c69b89-f077-4f20-ab40-68d85082562e:3469:1876539150176128:0@lo:400:kworker.0 00000100:00100000:0.0:1789607803.619545:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1876539150176384:12345-0@lo:400:kworker.0 Request processed in 47us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607803.619546:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607803.619555:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789607803.619577:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607803.619583:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150176640:0@lo:400:kworker.0 00000100:00100000:0.0:1789607803.619588:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150176896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607803.619620:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607803.619735:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607803.619741:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150176512:0@lo:400:kworker.0 00000100:00100000:3.0:1789607803.619764:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607803.619784:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150176128 00000100:00100000:3.0:1789607803.619788:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150176128 00000100:00100000:3.0:1789607803.619809:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789607803.619815:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+24:3469:x1876539150176128:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789607803.619989:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607803.619993:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607803.622137:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1876539150176896:12345-0@lo:400:kworker.0 Request processed in 2543us (2828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607803.622153:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607803.622160:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+24:3469:x1876539150176128:12345-0@lo:400:kworker.0 Request processed in 2341us (2611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607803.622171:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789607803.622187:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150176640 00000100:00100000:0.0:1789607803.622195:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150176640 00000100:00100000:0.0:1789607803.622236:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150176512 00000100:00080000:3.0:1789607803.622238:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789607803.622240:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150176512 00000100:00080000:3.0:1789607803.622260:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607803.622264:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789607803.622273:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150176256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607803.622321:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1876539150176256:12345-0@lo:400:kworker.0 Request processed in 49us (2975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607803.622327:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789607803.622357:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789607803.622363:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150176768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607803.622394:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150176768:12345-0@lo:400:kworker.0 Request processed in 31us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607803.622400:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789607803.622411:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789607803.622417:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150176640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607803.622445:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3469:x1876539150176640:12345-0@lo:400:kworker.0 Request processed in 28us (2836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607803.622451:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789607803.622462:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789607803.622469:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150176512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607803.622497:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150176512:12345-0@lo:400:kworker.0 Request processed in 29us (2732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607803.622503:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789607803.622562:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3471:1876539150176256:0@lo:400:kworker.0 00000100:00100000:0.0:1789607803.622575:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150176768:0@lo:400:kworker.0 00000100:00100000:0.0:1789607803.622587:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3471:1876539150176384:0@lo:400:kworker.0 00010000:00080000:0.0:1789607803.622600:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cffae680 x1876539150176896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607803.623216:0:23248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150175744 00000100:00100000:3.0:1789607803.623223:0:23248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150175744 00000100:00100000:0.0:1789607803.623525:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3471:1876539150176896:0@lo:400:kworker.0 00000100:00100000:1.0:1789607803.623649:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150176512:0@lo:400:kworker.0 00000100:00100000:1.0:1789607803.623662:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77c69b89-f077-4f20-ab40-68d85082562e:3469:1876539150176128:0@lo:400:kworker.0 00010000:00080000:1.0:1789607803.623673:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d78cffaea00 x1876539150176640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607803.623698:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3469:1876539150176640:0@lo:400:kworker.0 00000100:00100000:3.0:1789607803.624485:0:23248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789607803.624503:0:23248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150175744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607803.624531:0:23248:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607803.624623:0:23248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3470:x1876539150175744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (5784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607803.624688:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150175744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607803.626778:0:23248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789607803.627037:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789607803.814459:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607804.835019:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789607805.001088:0:24683:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8bf62be0 20000000:00000080:3.0:1789607805.001110:0:24683:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d77c504a000 uarg=0000000000000000 20000000:01000000:3.0:1789607805.001142:0:24683:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789607805.001147:0:24683:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789607805.001152:0:24683:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789607805.002001:0:24684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789607805.002148:0:24683:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789607805.009313:0:24683:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789607805.009341:0:24683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.009359:0:24683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fd59d200/0xa26202d240fbf1cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf1c4 expref: 23 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.009368:0:24683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbf1d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf1d2 expref: 23 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.009374:0:24683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c3f65a00/0xa26202d240fbf218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf211 expref: 23 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.009380:0:24683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78fcf77400/0xa26202d240fbf2b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf2ab expref: 23 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.009390:0:24683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d79018f1e00/0xa26202d240fbf4fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e81 expref: 12 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.009396:0:24683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d78c5bec200/0xa26202d240fbf53d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ef1 expref: 12 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.009403:0:24683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.009445:0:24683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c5bec200/0xa26202d240fbf53d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ef1 expref: 12 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.009471:0:24683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78c5bec200/0xa26202d240fbf53d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ef1 expref: 12 pid: 21923 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607805.009486:0:24683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cf7cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24683:1876539150177024:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607805.009770:0:24683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d79018f1e00/0xa26202d240fbf4fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e81 expref: 12 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.009779:0:24683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d79018f1e00/0xa26202d240fbf4fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e81 expref: 12 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607805.009787:0:24683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24683:1876539150177152:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607805.009821:0:24683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fcf77400/0xa26202d240fbf2b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbf2ab expref: 23 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.009828:0:24683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fcf77400/0xa26202d240fbf2b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbf2ab expref: 23 pid: 21924 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607805.009836:0:24683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24683:1876539150177280:0@lo:104: 00000100:00100000:3.0:1789607805.009906:0:24683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607805.009949:0:24683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78c3f65a00/0xa26202d240fbf218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbf211 expref: 23 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.009956:0:24683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78c3f65a00/0xa26202d240fbf218 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbf211 expref: 23 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607805.009965:0:24683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24683:1876539150177408:0@lo:104: 00000100:00100000:3.0:1789607805.009986:0:24683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607805.010026:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150177280 00000100:00100000:3.0:1789607805.010033:0:21914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150177280 00000100:00100000:3.0:1789607805.010069:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150177408 00000100:00100000:3.0:1789607805.010072:0:21914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150177408 00000100:00100000:3.0:1789607805.010083:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607805.010092:0:21914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c624aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+4:24683:x1876539150177280:12345-0@lo:104: 00010000:00010000:3.0:1789607805.010104:0:21914:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf2b2 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.010151:0:21914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607805.010156:0:21914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c624aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+4:24683:x1876539150177280:12345-0@lo:104: Request processed in 65us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607805.010163:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607805.010181:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789607805.010187:0:21914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:24683:x1876539150177408:12345-0@lo:104: 00010000:00010000:3.0:1789607805.010195:0:21914:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf218 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.010226:0:21914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789607805.010231:0:21914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:24683:x1876539150177408:12345-0@lo:104: Request processed in 45us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607805.010236:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789607805.010265:0:24683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbf1d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbf1d2 expref: 23 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.010274:0:24683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbf1d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbf1d2 expref: 23 pid: 21923 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607805.010282:0:24683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24683:1876539150177536:0@lo:104: 00000100:00100000:3.0:1789607805.010312:0:24683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607805.010330:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150177536 00000100:00100000:3.0:1789607805.010334:0:21914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150177536 00000100:00100000:3.0:1789607805.010350:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607805.010355:0:21914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:24683:x1876539150177536:12345-0@lo:104: 00010000:00010000:3.0:1789607805.010363:0:21914:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf1d9 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.010391:0:21914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789607805.010396:0:21914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:24683:x1876539150177536:12345-0@lo:104: Request processed in 42us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607805.010401:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789607805.010425:0:24683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d78fd59d200/0xa26202d240fbf1cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa26202d240fbf1c4 expref: 23 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.010434:0:24683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d78fd59d200/0xa26202d240fbf1cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa26202d240fbf1c4 expref: 23 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607805.010442:0:24683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24683:1876539150177664:0@lo:104: 00000100:00100000:3.0:1789607805.010464:0:24683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607805.010482:0:21914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150177664 00000100:00100000:3.0:1789607805.010486:0:21914:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150177664 00000100:00100000:3.0:1789607805.010502:0:21914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789607805.010507:0:21914:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c52ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:24683:x1876539150177664:12345-0@lo:104: 00010000:00010000:3.0:1789607805.010515:0:21914:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf1cb expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607805.010642:0:24683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607805.010663:0:24683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24683:1876539150177280:0@lo:104: 00000100:00100000:2.0:1789607805.010670:0:24683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24683:1876539150177408:0@lo:104: 00000100:00100000:2.0:1789607805.010676:0:24683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24683:1876539150177536:0@lo:104: 00000100:00100000:2.0:1789607805.010682:0:24683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24683:1876539150177664:0@lo:104: 00010000:00010000:2.0:1789607805.010704:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789607805.010710:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf2b2 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010717:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607805.010721:0:24106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbf2b2 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010729:0:24106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbf2b2 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607805.010737:0:24106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbf2b2 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607805.010750:0:24106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607805.010780:0:24106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf2b2 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010787:0:24106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607805.010805:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf2b2 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010812:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9400/0xa26202d240fbf2ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf2b2 expref: -99 pid: 23965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010823:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607805.010827:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf218 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010833:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f65400 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607805.010836:0:24106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbf218 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010843:0:24106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbf218 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607805.010849:0:24106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbf218 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607805.010853:0:24106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607805.010891:0:24106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf218 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010897:0:24106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607805.010910:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf218 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010916:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c3f65400/0xa26202d240fbf211 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf218 expref: -99 pid: 23243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010924:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607805.010927:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf1d9 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010932:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c3f64000 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:2.0:1789607805.010935:0:24106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbf1d9 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010941:0:24106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbf1d9 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607805.010947:0:24106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbf1d9 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607805.010952:0:24106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607805.010965:0:24106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf1d9 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010971:0:24106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607805.010981:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf1d9 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.010987:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d78c3f64000/0xa26202d240fbf1d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf1d9 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.011007:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607805.011009:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607805.011011:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607805.011034:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607805.011049:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150177792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607805.011177:0:21914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607805.011183:0:21914:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c52ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77c69b89-f077-4f20-ab40-68d85082562e+3:24683:x1876539150177664:12345-0@lo:104: Request processed in 675us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607805.011195:0:21914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789607805.011214:0:24106:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607805.011218:0:24106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa26202d240fbf1cb expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.011225:0:24106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9c00 already unused, calling callback (ffffffffc1dfbc20) 10000000:00010000:3.0:1789607805.011227:0:24106:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa26202d240fbf1cb expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.011235:0:24106:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa26202d240fbf1cb expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607805.011241:0:24106:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa26202d240fbf1cb expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607805.011247:0:24106:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789607805.011265:0:24106:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf1cb expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.011272:0:24106:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607805.011278:0:24106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf1cb expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.011285:0:24106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9c00/0xa26202d240fbf1c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa26202d240fbf1cb expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607805.011298:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607805.011299:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607805.011301:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607805.011658:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607805.011670:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150178048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607805.013050:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77c69b89-f077-4f20-ab40-68d85082562e:3471:1876539150178176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607805.013163:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607805.013213:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607805.013220:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150177920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607805.013245:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607805.013320:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150177792 00000100:00100000:2.0:1789607805.013327:0:21915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150177792 00010000:00010000:2.0:1789607805.013357:0:21915:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fcf77400/0xa26202d240fbf2b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf2ab expref: 24 pid: 21924 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607805.013381:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150177920 00000100:00100000:2.0:1789607805.013384:0:21915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150177920 00010000:00010000:2.0:1789607805.013394:0:21915:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c3f65a00/0xa26202d240fbf218 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf211 expref: 25 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607805.013407:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789607805.013414:0:21915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77c69b89-f077-4f20-ab40-68d85082562e+25:3468:x1876539150177792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607805.013427:0:21915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607805.013432:0:21915:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fcf77400/0xa26202d240fbf2b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf2ab expref: 25 pid: 21924 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.013442:0:21915:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fcf77400/0xa26202d240fbf2b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbf2ab expref: 25 pid: 21924 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.013470:0:21915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fcf77400/0xa26202d240fbf2b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbf2ab expref: 25 pid: 21924 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.013484:0:21915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607805.013520:0:21915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77c69b89-f077-4f20-ab40-68d85082562e+24:3468:x1876539150177792:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607805.013527:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607805.013708:0:21916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789607805.013717:0:21916:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77c69b89-f077-4f20-ab40-68d85082562e+24:3468:x1876539150177920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607805.013725:0:21916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607805.013731:0:21916:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c3f65a00/0xa26202d240fbf218 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf211 expref: 24 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607805.013739:0:21916:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c3f65a00/0xa26202d240fbf218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbf211 expref: 24 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607805.013761:0:21916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c3f65a00/0xa26202d240fbf218 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbf211 expref: 24 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607805.013770:0:21916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607805.013796:0:21916:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77c69b89-f077-4f20-ab40-68d85082562e+23:3468:x1876539150177920:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607805.013802:0:21916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607805.013850:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150177920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607805.013880:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77c69b89-f077-4f20-ab40-68d85082562e:3468:1876539150177792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607805.014009:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607805.014088:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150178048 00000100:00100000:2.0:1789607805.014092:0:21915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150178048 00010000:00010000:2.0:1789607805.014503:0:21915:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbf1d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf1d2 expref: 22 pid: 21923 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607805.014567:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607805.014684:0:21915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77c69b89-f077-4f20-ab40-68d85082562e+22:3470:x1876539150178048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607805.014697:0:21915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607805.014703:0:21915:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbf1d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf1d2 expref: 22 pid: 21923 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.014713:0:21915:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbf1d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbf1d2 expref: 22 pid: 21923 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.014725:0:21915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fcf77000/0xa26202d240fbf1d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbf1d2 expref: 22 pid: 21923 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.014736:0:21915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607805.014836:0:21915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77c69b89-f077-4f20-ab40-68d85082562e+21:3470:x1876539150178048:12345-0@lo:103:ldlm_bl.0 Request processed in 262us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607805.014843:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607805.014952:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607805.015067:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77c69b89-f077-4f20-ab40-68d85082562e:3470:1876539150178048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607805.015518:0:21917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150178176 00000100:00100000:1.0:1789607805.015525:0:21917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150178176 00010000:00010000:1.0:1789607805.015557:0:21917:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78fd59d200/0xa26202d240fbf1cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf1c4 expref: 21 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607805.015575:0:21917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607805.015581:0:21917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77c69b89-f077-4f20-ab40-68d85082562e+21:3471:x1876539150178176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607805.015591:0:21917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607805.015609:0:21917:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78fd59d200/0xa26202d240fbf1cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa26202d240fbf1c4 expref: 21 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607805.015618:0:21917:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78fd59d200/0xa26202d240fbf1cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa26202d240fbf1c4 expref: 21 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607805.015629:0:21917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78fd59d200/0xa26202d240fbf1cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa26202d240fbf1c4 expref: 21 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607805.015639:0:21917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607805.015679:0:21917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77c69b89-f077-4f20-ab40-68d85082562e+20:3471:x1876539150178176:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607805.015685:0:21917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789607805.015848:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d77c52ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77c69b89-f077-4f20-ab40-68d85082562e:3471:1876539150178176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607805.017164:0:24683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cf7cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24683:1876539150177024:192.168.203.25@tcp:104: 00000100:00100000:2.0:1789607805.017176:0:24683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24683:1876539150177152:192.168.203.25@tcp:104: 00010000:00010000:2.0:1789607805.017210:0:24683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607805.017734:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607805.018261:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607805.018393:0:21917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130143616 00000100:00100000:2.0:1789607805.018402:0:21917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130143616 00010000:00010000:2.0:1789607805.018438:0:21917:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d78c5bec200/0xa26202d240fbf53d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ef1 expref: 13 pid: 21923 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607805.018476:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130143744 00000100:00100000:0.0:1789607805.018480:0:21915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130143744 00010000:00010000:0.0:1789607805.018498:0:21915:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d79018f1e00/0xa26202d240fbf4fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e81 expref: 14 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607805.018529:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:0.0:1789607805.018549:0:21915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd13a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6585db7-cc05-4c19-a878-e5ff79e86fce+14:2395:x1876539130143616:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607805.018564:0:21915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607805.018570:0:21915:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d78c5bec200/0xa26202d240fbf53d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ef1 expref: 14 pid: 21923 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018591:0:21915:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d78c5bec200/0xa26202d240fbf53d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ef1 expref: 14 pid: 21923 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018616:0:21915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d78c5bec200/0xa26202d240fbf53d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668ef1 expref: 14 pid: 21923 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018630:0:21915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607805.018722:0:21915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd13a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:2395:x1876539130143616:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 183us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607805.018730:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 13 00000100:00100000:0.0:1789607805.018787:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 14 00000100:00100000:0.0:1789607805.018794:0:21915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6585db7-cc05-4c19-a878-e5ff79e86fce+12:2395:x1876539130143744:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607805.018817:0:21915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607805.018822:0:21915:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d79018f1e00/0xa26202d240fbf4fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e81 expref: 12 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018831:0:21915:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d79018f1e00/0xa26202d240fbf4fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e81 expref: 12 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018841:0:21915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d79018f1e00/0xa26202d240fbf4fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668e81 expref: 12 pid: 21925 timeout: 809 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018855:0:21915:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018898:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018915:0:21915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018923:0:21915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018930:0:21915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018937:0:21915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018944:0:21915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8c00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607805.018948:0:21915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018967:0:21915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018983:0:21915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607805.018993:0:21915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607805.019012:0:21915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:2395:x1876539130143744:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 219us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607805.019017:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 14 00010000:00010000:2.0:1789607805.019735:0:24683:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.020087:0:24683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607805.020094:0:24683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7900ef8c00/0xa26202d240fbf56e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607805.282964:0:21964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789607805.858396:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607806.438699:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.441830:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130143872 00000100:00100000:0.0:1789607806.441845:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130143872 00000100:00100000:0.0:1789607806.441968:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:0.0:1789607806.441982:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:18982:x1876539130143872:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607806.442004:0:23783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607806.442025:0:23783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1a00/0xa26202d240fbf575 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f29 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442089:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf57c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442104:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf57c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442116:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf57c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442129:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf583 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442151:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442158:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442661:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1600/0xa26202d240fbf58a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442672:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1600/0xa26202d240fbf58a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442679:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1600/0xa26202d240fbf58a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607806.442705:0:23783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789607806.442708:0:23783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607806.442743:0:23783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1600/0xa26202d240fbf58a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442754:0:23783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf57c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442760:0:23783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf57c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442766:0:23783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf57c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442772:0:23783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f0a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607806.442775:0:23783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf57c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442789:0:23783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf57c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442801:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:0.0:1789607806.442804:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607806.442809:0:23783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf57c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442815:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf57c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442828:0:23783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442833:0:23783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf583 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442838:0:23783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf583 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442843:0:23783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f1e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607806.442845:0:23783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf583 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442850:0:23783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf583 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.442856:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d78e28a4300) 00010000:00010000:0.0:1789607806.442858:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607806.442902:0:23783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf583 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789607806.443003:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789607806.443041:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf583 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.443080:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1a00/0xa26202d240fbf575 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f29 expref: 8 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.443093:0:23783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1600/0xa26202d240fbf58a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f29 expref: 7 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.443100:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:0.0:1789607806.443102:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607806.443104:0:23783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f1600, rc 0) 00000100:00100000:0.0:1789607806.443206:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:18982:x1876539130143872:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1228us (4516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607806.443213:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:3.0:1789607806.455568:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607806.455716:0:21942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130144000 00000100:00100000:1.0:1789607806.455726:0:21942:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130144000 00000100:00100000:1.0:1789607806.455783:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:1.0:1789607806.455794:0:21942:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:18982:x1876539130144000:12345-192.168.203.25@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789607806.455940:0:21942:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:18982:x1876539130144000:12345-192.168.203.25@tcp:900:lhsmtool_posix.0 Request processed in 148us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607806.455948:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:1.0:1789607806.460516:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.460624:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130144256 00000100:00100000:0.0:1789607806.460634:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130144256 00000100:00100000:0.0:1789607806.460695:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:0.0:1789607806.460705:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:18982:x1876539130144256:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607806.460726:0:21932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607806.460745:0:21932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1a00/0xa26202d240fbf591 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f30 expref: -99 pid: 21932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.460814:0:21932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf598 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.460828:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf598 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.460853:0:21932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf598 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.460898:0:21932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf59f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.460907:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf59f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.460913:0:21932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf59f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461241:0:21932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1200/0xa26202d240fbf5a6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461250:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1200/0xa26202d240fbf5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461257:0:21932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1200/0xa26202d240fbf5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607806.461268:0:21932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789607806.461460:0:21932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf598 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461468:0:21932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf598 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461475:0:21932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf598 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461481:0:21932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f1e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607806.461493:0:21932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf598 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461501:0:21932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf598 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461513:0:21932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d78e28a4800) 00010000:00010000:0.0:1789607806.461516:0:21932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607806.461521:0:21932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf598 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461527:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf598 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461544:0:21932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf59f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461551:0:21932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf59f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461556:0:21932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf59f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461561:0:21932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f0a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607806.461564:0:21932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf59f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461570:0:21932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf59f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461578:0:21932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d78e28a4300) 00010000:00010000:0.0:1789607806.461580:0:21932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607806.461599:0:21932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf59f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.461606:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf59f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.462212:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1a00/0xa26202d240fbf591 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f30 expref: 10 pid: 21932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.462231:0:21932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1200/0xa26202d240fbf5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f30 expref: 9 pid: 21932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.462239:0:21932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78e28a4200) 00010000:00010000:0.0:1789607806.462241:0:21932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607806.462243:0:21932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f1200, rc 0) 00000100:00100000:0.0:1789607806.462300:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+9:18982:x1876539130144256:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1596us (1794us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789607806.462308:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:3.0:1789607806.474656:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607806.474902:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130144384 00000100:00100000:1.0:1789607806.474912:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130144384 00000100:00100000:1.0:1789607806.474973:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:1.0:1789607806.474984:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+9:18982:x1876539130144384:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789607806.475092:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+9:18982:x1876539130144384:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 Request processed in 110us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607806.475113:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:1.0:1789607806.486639:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.487964:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130144512 00000100:00100000:0.0:1789607806.487978:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130144512 00000100:00100000:0.0:1789607806.488116:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:0.0:1789607806.488129:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:18982:x1876539130144512:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1789607806.490685:0:21932:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2513us 00000100:00080000:3.0:1789607806.492545:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607806.497518:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.497800:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130144640 00000100:00100000:0.0:1789607806.497810:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130144640 00000100:00100000:0.0:1789607806.497901:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:0.0:1789607806.497912:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+9:18988:x1876539130144640:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607806.497933:0:23783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607806.497953:0:23783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1a00/0xa26202d240fbf5b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f37 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498024:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498037:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498049:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498062:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf5c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498069:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498075:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498248:0:23783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498255:0:23783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498262:0:23783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498268:0:23783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f0a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607806.498273:0:23783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498289:0:23783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498300:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:0.0:1789607806.498304:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607806.498309:0:23783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498315:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498327:0:23783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498333:0:23783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf5c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498339:0:23783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498344:0:23783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f1e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607806.498347:0:23783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498352:0:23783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf5c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498359:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d78e28a4300) 00010000:00010000:0.0:1789607806.498361:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607806.498364:0:23783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf5c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498379:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf5c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498416:0:23783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1a00/0xa26202d240fbf5b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f37 expref: 10 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498426:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:0.0:1789607806.498428:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607806.498432:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1a00/0xa26202d240fbf5b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f37 expref: 10 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.498442:0:23783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f1a00, rc 0) 00000100:00100000:0.0:1789607806.498499:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+9:18988:x1876539130144640:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 589us (990us total) trans 0 rc 301/301 00000100:00100000:0.0:1789607806.498506:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 27 00000100:00100000:0.0:1789607806.503196:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607806.503313:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130144768 00000100:00100000:1.0:1789607806.503324:0:21939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130144768 00000100:00100000:1.0:1789607806.503383:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:1.0:1789607806.503394:0:21939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+9:18988:x1876539130144768:12345-192.168.203.25@tcp:700:lfs.0 00000100:00100000:1.0:1789607806.503469:0:21939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+9:18988:x1876539130144768:12345-192.168.203.25@tcp:700:lfs.0 Request processed in 77us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607806.503477:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:0.0:1789607806.505499:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:18982:x1876539130144512:12345-192.168.203.25@tcp:59:lhsmtool_posix.0 Request processed in 17364us (18860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607806.505512:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:3.0:1789607806.506283:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607806.506465:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130145024 00000100:00100000:3.0:1789607806.506475:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130145024 00000100:00100000:3.0:1789607806.506619:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:3.0:1789607806.506632:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+9:18988:x1876539130145024:12345-192.168.203.25@tcp:36:lfs.0 00010000:00010000:3.0:1789607806.506683:0:21931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607806.506709:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1800/0xa26202d240fbf528 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668eb2 expref: 9 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.506734:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:3.0:1789607806.506739:0:21931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607806.506976:0:21931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.506990:0:21931:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf567 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f22 expref: 5 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.506999:0:21931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.507039:0:21931:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f22 expref: 5 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.507053:0:21931:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf567 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f22 expref: 5 pid: 21930 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607806.507067:0:21931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b98000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:21931:1876539150178304:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607806.507140:0:21931:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452780 going to sleep for 11 seconds 00000100:00100000:0.0:1789607806.516780:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607806.517195:0:21931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b98000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:21931:1876539150178304:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607806.517223:0:21931:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607806.517421:0:21916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130145152 00000100:00100000:1.0:1789607806.517429:0:21916:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130145152 00010000:00010000:1.0:1789607806.517482:0:21916:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf567 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f22 expref: 6 pid: 21930 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607806.517515:0:21916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 15 00000100:00080000:3.0:1789607806.517552:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607806.517660:0:21916:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84cf179-1248-41a2-8641-5e45322bb8df+6:2396:x1876539130145152:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607806.517678:0:21916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607806.517685:0:21916:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf567 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f22 expref: 6 pid: 21930 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.517698:0:21916:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf567 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f22 expref: 6 pid: 21930 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.517720:0:21916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf567 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f22 expref: 6 pid: 21930 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.518126:0:21916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:1.0:1789607806.518131:0:21916:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.518141:0:21916:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.518149:0:21916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.518217:0:21916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607806.518283:0:21916:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f84cf179-1248-41a2-8641-5e45322bb8df+5:2396:x1876539130145152:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 759us (1511us total) trans 0 rc 0/0 00010000:00010000:3.0:1789607806.518307:0:21931:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.518314:0:21931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.518339:0:21931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbf5d0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.518348:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbf5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.518356:0:21931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbf5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.519680:0:21931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbf5d7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.519700:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbf5d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.519709:0:21931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbf5d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607806.519724:0:21931:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcfce7b7 reply state 00000000f961bf8a transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbf5d7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.519734:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbf5d7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607806.520365:0:21916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 15 00010000:00010000:3.0:1789607806.520701:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:3.0:1789607806.520706:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789607806.520711:0:21931:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789607806.520717:0:21931:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789607806.520728:0:21931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.520736:0:21931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.520744:0:21931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.520758:0:21931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8e00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607806.520764:0:21931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.520771:0:21931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.520802:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78e28a4a00) 00010000:00010000:3.0:1789607806.520804:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607806.520808:0:21931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.520815:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf5c9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607806.520836:0:21931:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcfce7b7 reply state 00000000f961bf8a transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbf5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.520850:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbf5d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.520882:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607806.520885:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789607806.520887:0:21931:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789607806.520983:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+10:18988:x1876539130145024:12345-192.168.203.25@tcp:36:lfs.0 Request processed in 14353us (14703us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789607806.520992:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 28 00000100:00100000:0.0:1789607806.592060:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607806.592158:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130145280 00000100:00100000:2.0:1789607806.592167:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130145280 00000100:00100000:2.0:1789607806.592236:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 29 00000100:00100000:2.0:1789607806.592247:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+10:18996:x1876539130145280:12345-192.168.203.25@tcp:101:lctl.0 00010000:00010000:2.0:1789607806.592271:0:21930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607806.592296:0:21930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf5de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f3e expref: -99 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.592374:0:21930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59ca00/0xa26202d240fbf5e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.592388:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59ca00/0xa26202d240fbf5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.592401:0:21930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59ca00/0xa26202d240fbf5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607806.592438:0:21930:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789607806.592443:0:21930:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789607806.592481:0:21930:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59ca00/0xa26202d240fbf5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.592507:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf5de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f3e expref: 12 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.592527:0:21930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59ca00/0xa26202d240fbf5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f3e expref: 11 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.592535:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c7c2b200) 00010000:00010000:2.0:1789607806.592538:0:21930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607806.592541:0:21930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59ca00, rc 0) 00000100:00100000:2.0:1789607806.592625:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+11:18996:x1876539130145280:12345-192.168.203.25@tcp:101:lctl.0 Request processed in 381us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607806.592632:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 29 00000040:00080000:3.0:1789607806.628775:0:22590:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789607806.632400:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.632479:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130145408 00000100:00100000:0.0:1789607806.632489:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130145408 00000100:00100000:0.0:1789607806.632546:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:0.0:1789607806.632557:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84cf179-1248-41a2-8641-5e45322bb8df+5:18997:x1876539130145408:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607806.632594:0:23783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607806.632628:0:23783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf5ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f45 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.632691:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.632704:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.632714:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607806.632746:0:23783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789607806.632762:0:23783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1789607806.632784:0:23783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.632805:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf5ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f45 expref: 7 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.632826:0:23783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0a00/0xa26202d240fbf5f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f45 expref: 6 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.632834:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c7c2b200) 00010000:00010000:0.0:1789607806.632837:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607806.632841:0:23783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f0a00, rc 0) 00000100:00100000:0.0:1789607806.632937:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84cf179-1248-41a2-8641-5e45322bb8df+6:18997:x1876539130145408:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 381us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607806.632945:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 30 00000100:00100000:3.0:1789607806.637059:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607806.637399:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130145536 00000100:00100000:2.0:1789607806.637409:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130145536 00000100:00100000:2.0:1789607806.637469:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:2.0:1789607806.637478:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84cf179-1248-41a2-8641-5e45322bb8df+6:18997:x1876539130145536:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607806.637499:0:21930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607806.637518:0:21930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf5fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f4c expref: -99 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637595:0:21930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf601 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637610:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637623:0:21930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637635:0:21930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbf608 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637642:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbf608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637648:0:21930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbf608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637730:0:21930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59da00/0xa26202d240fbf60f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637738:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59da00/0xa26202d240fbf60f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637745:0:21930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59da00/0xa26202d240fbf60f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607806.637787:0:21930:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789607806.637790:0:21930:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789607806.637811:0:21930:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59da00/0xa26202d240fbf60f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637822:0:21930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637829:0:21930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf601 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637836:0:21930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637842:0:21930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59d600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607806.637847:0:21930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637854:0:21930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf601 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637883:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c7c2b200) 00010000:00010000:2.0:1789607806.637887:0:21930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607806.637892:0:21930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637899:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637912:0:21930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbf608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637929:0:21930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbf608 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637935:0:21930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbf608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637939:0:21930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59c600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607806.637942:0:21930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbf608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637949:0:21930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbf608 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637972:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d78d9b83300) 00010000:00010000:2.0:1789607806.637974:0:21930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607806.637977:0:21930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbf608 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.637982:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbf608 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.638008:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf5fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f4c expref: 8 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.638020:0:21930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59da00/0xa26202d240fbf60f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f4c expref: 7 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.638027:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:2.0:1789607806.638030:0:21930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607806.638038:0:21930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59da00, rc 0) 00000100:00100000:2.0:1789607806.638103:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84cf179-1248-41a2-8641-5e45322bb8df+7:18997:x1876539130145536:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 626us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607806.638111:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 31 00000100:00100000:1.0:1789607806.641734:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607806.641835:0:21942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130145664 00000100:00100000:3.0:1789607806.641845:0:21942:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130145664 00000100:00100000:3.0:1789607806.641938:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:3.0:1789607806.641948:0:21942:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f84cf179-1248-41a2-8641-5e45322bb8df+5:18997:x1876539130145664:12345-192.168.203.25@tcp:900:lfs.0 00000100:00100000:3.0:1789607806.642029:0:21942:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f84cf179-1248-41a2-8641-5e45322bb8df+5:18997:x1876539130145664:12345-192.168.203.25@tcp:900:lfs.0 Request processed in 82us (304us total) trans 0 rc 0/0 00000100:00080000:0.0:1789607806.642147:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789607806.642409:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:3.0:1789607806.645848:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.645973:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130145920 00000100:00100000:0.0:1789607806.645983:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130145920 00000100:00100000:0.0:1789607806.646054:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:0.0:1789607806.646065:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84cf179-1248-41a2-8641-5e45322bb8df+7:18997:x1876539130145920:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607806.646088:0:23783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607806.646108:0:23783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf616 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f53 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607806.646209:0:23783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789607806.646328:0:23783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf616 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f53 expref: 9 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.646342:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c7c2b200) 00010000:00010000:0.0:1789607806.646345:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607806.646351:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1e00/0xa26202d240fbf616 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f53 expref: 9 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.646366:0:23783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f1e00, rc 0) 00000100:00100000:0.0:1789607806.646415:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84cf179-1248-41a2-8641-5e45322bb8df+8:18997:x1876539130145920:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 352us (576us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1789607806.646422:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 32 00000100:00100000:1.0:1789607806.650221:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607806.650308:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130146176 00000100:00100000:2.0:1789607806.650319:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130146176 00000100:00100000:2.0:1789607806.650378:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:2.0:1789607806.650390:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84cf179-1248-41a2-8641-5e45322bb8df+8:18997:x1876539130146176:12345-192.168.203.25@tcp:36:lfs.0 00010000:00010000:2.0:1789607806.650446:0:21930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607806.650474:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59da00/0xa26202d240fbf60f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f4c expref: 8 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.650491:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:2.0:1789607806.650497:0:21930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607806.650517:0:21930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf624 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.650528:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf624 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.650537:0:21930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf624 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607806.650761:0:21930:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000942770d5 reply state 0000000085cd6596 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf624 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.650775:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf624 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.650781:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:2.0:1789607806.650795:0:21930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789607806.650798:0:21930:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789607806.650806:0:21930:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789607806.650929:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84cf179-1248-41a2-8641-5e45322bb8df+9:18997:x1876539130146176:12345-192.168.203.25@tcp:36:lfs.0 Request processed in 541us (720us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789607806.650936:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 33 00000100:00100000:1.0:1789607806.659312:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.659452:0:21934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130146432 00000100:00100000:0.0:1789607806.659462:0:21934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130146432 00000100:00100000:0.0:1789607806.659518:0:21934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:0.0:1789607806.659529:0:21934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84cf179-1248-41a2-8641-5e45322bb8df+9:18997:x1876539130146432:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1789607806.659938:0:21934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84cf179-1248-41a2-8641-5e45322bb8df+10:18997:x1876539130146432:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 410us (634us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1789607806.659963:0:21934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:3.0:1789607806.663167:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.663411:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130146688 00000100:00100000:0.0:1789607806.663421:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130146688 00000100:00100000:0.0:1789607806.664082:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:0.0:1789607806.664096:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84cf179-1248-41a2-8641-5e45322bb8df+10:18997:x1876539130146688:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607806.664122:0:23783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607806.664141:0:23783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0e00/0xa26202d240fbf62b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f5a expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664211:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf632 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664225:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf632 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664237:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf632 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664247:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0400/0xa26202d240fbf639 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664256:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0400/0xa26202d240fbf639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664263:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0400/0xa26202d240fbf639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607806.664370:0:23783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789607806.664453:0:23783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf632 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664480:0:23783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf632 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664487:0:23783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf632 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664493:0:23783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f1c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607806.664497:0:23783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf632 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664505:0:23783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf632 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664515:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c7c2b200) 00010000:00010000:0.0:1789607806.664518:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607806.664523:0:23783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf632 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664529:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664547:0:23783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0400/0xa26202d240fbf639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664553:0:23783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0400/0xa26202d240fbf639 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664558:0:23783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0400/0xa26202d240fbf639 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.664562:0:23783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f0400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607806.666164:0:23783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0400/0xa26202d240fbf639 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.666177:0:23783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0400/0xa26202d240fbf639 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.666192:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d78d9b83300) 00010000:00010000:0.0:1789607806.666195:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607806.666199:0:23783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0400/0xa26202d240fbf639 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.666205:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0400/0xa26202d240fbf639 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.666347:0:23783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0e00/0xa26202d240fbf62b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f5a expref: 12 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.666360:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c7c2b200) 00010000:00010000:1.0:1789607806.666364:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789607806.666368:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0e00/0xa26202d240fbf62b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f5a expref: 12 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.666381:0:23783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f0e00, rc 0) 00000100:00100000:1.0:1789607806.666471:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f84cf179-1248-41a2-8641-5e45322bb8df+11:18997:x1876539130146688:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 2377us (3311us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1789607806.666480:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 34 00000100:00100000:1.0:1789607806.672450:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607806.672806:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130146816 00000100:00100000:3.0:1789607806.672816:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130146816 00000100:00100000:3.0:1789607806.672890:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:3.0:1789607806.672901:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84cf179-1248-41a2-8641-5e45322bb8df+11:18997:x1876539130146816:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:2.0:1789607806.673655:0:21930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607806.673682:0:21930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbf647 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f61 expref: -99 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.673776:0:21930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf64e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.673791:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf64e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.673802:0:21930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf64e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607806.673827:0:21930:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789607806.673831:0:21930:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789607806.673849:0:21930:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf64e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.673915:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c600/0xa26202d240fbf647 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f61 expref: 13 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.673932:0:21930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf64e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f61 expref: 12 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.673942:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:2.0:1789607806.673958:0:21930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607806.673962:0:21930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59d600, rc 0) 00000100:00100000:2.0:1789607806.674020:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84cf179-1248-41a2-8641-5e45322bb8df+12:18997:x1876539130146816:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 1120us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607806.674027:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 35 00000100:00100000:1.0:1789607806.683461:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607806.683750:0:21933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130146944 00000100:00100000:3.0:1789607806.683762:0:21933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130146944 00000100:00100000:2.0:1789607806.684912:0:21933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:0.0:1789607806.684920:0:21934:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1789607806.684925:0:21933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84cf179-1248-41a2-8641-5e45322bb8df+12:18997:x1876539130146944:12345-192.168.203.25@tcp:37:lfs.0 00000100:00100000:0.0:1789607806.684929:0:21934:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1789607806.689332:0:21933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f84cf179-1248-41a2-8641-5e45322bb8df+12:18997:x1876539130146944:12345-192.168.203.25@tcp:37:lfs.0 Request processed in 4399us (5872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607806.689345:0:21933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:1.0:1789607806.700970:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.701118:0:21934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130147200 00000100:00100000:0.0:1789607806.701129:0:21934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130147200 00000100:00100000:0.0:1789607806.701225:0:21934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:0.0:1789607806.701253:0:21934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c415d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84cf179-1248-41a2-8641-5e45322bb8df+12:18997:x1876539130147200:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1789607806.701511:0:21934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c415d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f84cf179-1248-41a2-8641-5e45322bb8df+13:18997:x1876539130147200:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 275us (549us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1789607806.701519:0:21934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:1.0:1789607806.777705:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607806.777849:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130147328 00000100:00100000:3.0:1789607806.777896:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130147328 00000100:00100000:3.0:1789607806.777964:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:3.0:1789607806.777975:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+11:19003:x1876539130147328:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:3.0:1789607806.777995:0:21931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607806.778016:0:21931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf655 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f68 expref: -99 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778078:0:21931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbf65c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778092:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbf65c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778104:0:21931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbf65c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778114:0:21931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbf663 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778140:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbf663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778148:0:21931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbf663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778241:0:21931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbf66a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778251:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbf66a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778259:0:21931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbf66a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607806.778288:0:21931:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789607806.778291:0:21931:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607806.778329:0:21931:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbf66a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778342:0:21931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbf65c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778348:0:21931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbf65c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778356:0:21931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbf65c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778362:0:21931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607806.778366:0:21931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbf65c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778380:0:21931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbf65c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778393:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c7c2b200) 00010000:00010000:3.0:1789607806.778396:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607806.778401:0:21931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbf65c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778408:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9200/0xa26202d240fbf65c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778422:0:21931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbf663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778428:0:21931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbf663 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778433:0:21931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbf663 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778439:0:21931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef8a00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607806.778441:0:21931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbf663 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778447:0:21931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbf663 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778454:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d78d9b83300) 00010000:00010000:3.0:1789607806.778456:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607806.778458:0:21931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbf663 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778475:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8a00/0xa26202d240fbf663 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778504:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8e00/0xa26202d240fbf655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f68 expref: 13 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778518:0:21931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8800/0xa26202d240fbf66a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f68 expref: 12 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.778525:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:3.0:1789607806.778527:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789607806.778530:0:21931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8800, rc 0) 00000100:00100000:2.0:1789607806.779168:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+12:19003:x1876539130147328:12345-192.168.203.25@tcp:101:bash.0 Request processed in 1190us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607806.779179:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 36 00000100:00100000:1.0:1789607806.782227:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607806.782387:0:21941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130147456 00000100:00100000:2.0:1789607806.782397:0:21941:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130147456 00000100:00100000:2.0:1789607806.782443:0:21941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:2.0:1789607806.782454:0:21941:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:19003:x1876539130147456:12345-192.168.203.25@tcp:900:bash.0 00000100:00100000:2.0:1789607806.782540:0:21941:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:19003:x1876539130147456:12345-192.168.203.25@tcp:900:bash.0 Request processed in 87us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607806.782548:0:21941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:1.0:1789607806.786567:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.786652:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130147712 00000100:00100000:0.0:1789607806.786662:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130147712 00000100:00100000:0.0:1789607806.786723:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:0.0:1789607806.786732:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+12:19003:x1876539130147712:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:0.0:1789607806.786753:0:21932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607806.786773:0:21932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0400/0xa26202d240fbf671 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f6f expref: -99 pid: 21932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.786939:0:21932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.786955:0:21932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf64e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f61 expref: 12 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.786964:0:21932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.786999:0:21932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf64e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f61 expref: 12 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.787013:0:21932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf64e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f61 expref: 12 pid: 21930 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607806.787027:0:21932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffae300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21932:1876539150178432:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607806.787114:0:21932:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c6ae1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789607806.787853:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.787963:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130147840 00000100:00100000:0.0:1789607806.787970:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130147840 00000100:00100000:0.0:1789607806.788042:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 148 00000100:00100000:0.0:1789607806.788051:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+11:18363:x1876539130147840:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607806.788062:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607806.788077:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d79018f1e00/0xa26202d240fbf67f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f76 expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.788099:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d79018f1e00/0xa26202d240fbf67f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f76 expref: 12 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.788124:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d79018f1e00/0xa26202d240fbf67f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f76 expref: 12 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.788133:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f1e00, rc 0) 00000100:00100000:0.0:1789607806.788216:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+12:18363:x1876539130147840:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 166us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607806.788224:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 148 00000100:00100000:1.0:1789607806.791324:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.791439:0:21932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffae300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21932:1876539150178432:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607806.791466:0:21932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607806.791541:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.791627:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130148096 00000100:00100000:0.0:1789607806.791634:0:21915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130148096 00010000:00010000:0.0:1789607806.791669:0:21915:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf64e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f61 expref: 13 pid: 21930 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607806.791708:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 16 00000100:00100000:0.0:1789607806.791717:0:21915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84cf179-1248-41a2-8641-5e45322bb8df+13:2396:x1876539130148096:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607806.791731:0:21915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607806.791738:0:21915:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf64e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f61 expref: 13 pid: 21930 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.791761:0:21915:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf64e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f61 expref: 13 pid: 21930 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.791783:0:21915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf64e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f61 expref: 13 pid: 21930 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.791811:0:21915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:0.0:1789607806.791817:0:21915:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.791825:0:21915:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.791843:0:21915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.791903:0:21915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607806.791950:0:21915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84cf179-1248-41a2-8641-5e45322bb8df+12:2396:x1876539130148096:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 233us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607806.791957:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 16 00010000:00010000:1.0:1789607806.792088:0:21932:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.792095:0:21932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.792136:0:21932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf686 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.792145:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf686 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.792152:0:21932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf686 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.792842:0:21932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed200/0xa26202d240fbf68d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.792852:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed200/0xa26202d240fbf68d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.792898:0:21932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed200/0xa26202d240fbf68d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607806.792910:0:21932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789607806.792941:0:21932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.792948:0:21932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.792955:0:21932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.792960:0:21932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f1c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607806.792965:0:21932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.792972:0:21932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.792982:0:21932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:1.0:1789607806.792985:0:21932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607806.792989:0:21932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.792995:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf678 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607806.793012:0:21932:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000193f287a reply state 00000000eec57cb4 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf686 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.793033:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf686 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.793040:0:21932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8d78d3041c00) 00010000:00010000:1.0:1789607806.793042:0:21932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789607806.793045:0:21932:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789607806.793083:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0400/0xa26202d240fbf671 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f6f expref: 15 pid: 21932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.793096:0:21932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed200/0xa26202d240fbf68d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f6f expref: 14 pid: 21932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.793102:0:21932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:1.0:1789607806.793104:0:21932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789607806.793106:0:21932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c5bed200, rc 0) 00000100:00100000:1.0:1789607806.793145:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+15:19003:x1876539130147712:12345-192.168.203.25@tcp:101:bash.0 Request processed in 6415us (7114us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1789607806.793153:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 37 00000100:00100000:3.0:1789607806.794029:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130147968 00000100:00100000:3.0:1789607806.794559:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130147968 00000100:00100000:3.0:1789607806.794641:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 149 00000100:00100000:3.0:1789607806.794652:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+12:18363:x1876539130147968:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.795784:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+12:18363:x1876539130147968:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 1127us (4462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607806.795795:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 149 00000100:00100000:1.0:1789607806.799363:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.799444:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130148224 00000100:00100000:0.0:1789607806.799453:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130148224 00000100:00100000:0.0:1789607806.799507:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 150 00000100:00100000:0.0:1789607806.799518:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+12:18363:x1876539130148224:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607806.800469:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+12:18363:x1876539130148224:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 947us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607806.800479:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 150 00000100:00100000:1.0:1789607806.808837:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607806.809751:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130148352 00000100:00100000:3.0:1789607806.809763:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130148352 00000100:00100000:2.0:1789607806.811113:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 151 00000100:00100000:2.0:1789607806.811127:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+12:18363:x1876539130148352:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607806.811145:0:21925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607806.811163:0:21925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78fd59c600/0xa26202d240fbf69b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f7d expref: -99 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.811218:0:21925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78fd59c600/0xa26202d240fbf69b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f7d expref: 13 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.811230:0:21925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78fd59c600/0xa26202d240fbf69b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f7d expref: 13 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.811239:0:21925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59c600, rc 0) 00000100:00100000:2.0:1789607806.811308:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18363:x1876539130148352:12345-192.168.203.25@tcp:101:ll_cfg_requeue.0 Request processed in 183us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607806.811752:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 151 00000100:00100000:1.0:1789607806.814796:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.815423:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130148480 00000100:00100000:0.0:1789607806.815434:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130148480 00000100:00100000:0.0:1789607806.815732:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 152 00000100:00100000:0.0:1789607806.815744:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18363:x1876539130148480:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607806.816180:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18363:x1876539130148480:12345-192.168.203.25@tcp:501:ll_cfg_requeue.0 Request processed in 437us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607806.816195:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 152 00000100:00100000:3.0:1789607806.816304:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607806.816406:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130148608 00000100:00100000:1.0:1789607806.816412:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130148608 00000100:00100000:1.0:1789607806.816566:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:1.0:1789607806.816576:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+15:19003:x1876539130148608:12345-192.168.203.25@tcp:101:bash.0 00010000:00010000:1.0:1789607806.816611:0:23783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607806.816636:0:23783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed800/0xa26202d240fbf6a2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f84 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.816696:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec600/0xa26202d240fbf6a9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.816710:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec600/0xa26202d240fbf6a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.816721:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec600/0xa26202d240fbf6a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607806.816758:0:23783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789607806.816762:0:23783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789607806.816779:0:23783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec600/0xa26202d240fbf6a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.816789:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec600/0xa26202d240fbf6a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.816813:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed800/0xa26202d240fbf6a2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f84 expref: 17 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.817087:0:23783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec600/0xa26202d240fbf6a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f84 expref: 16 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.817097:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:1.0:1789607806.817100:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607806.817104:0:23783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c5bec600, rc 0) 00000100:00100000:1.0:1789607806.817150:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+16:19003:x1876539130148608:12345-192.168.203.25@tcp:101:bash.0 Request processed in 577us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607806.817167:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 38 00000100:00100000:3.0:1789607806.821406:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607806.821502:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130148736 00000100:00100000:2.0:1789607806.821513:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130148736 00000100:00100000:1.0:1789607806.821640:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 153 00000100:00100000:1.0:1789607806.821652:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18363:x1876539130148736:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607806.821897:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:18363:x1876539130148736:12345-192.168.203.25@tcp:503:ll_cfg_requeue.0 Request processed in 247us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607806.821905:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 153 00000100:00100000:2.0:1789607806.825677:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607806.825936:0:21933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130148992 00000100:00100000:1.0:1789607806.825946:0:21933:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130148992 00000100:00100000:1.0:1789607806.826005:0:21933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:1.0:1789607806.826016:0:21933:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+16:19003:x1876539130148992:12345-192.168.203.25@tcp:35:bash.0 00000100:00100000:1.0:1789607806.826400:0:21933:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+17:19003:x1876539130148992:12345-192.168.203.25@tcp:35:bash.0 Request processed in 384us (731us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1789607806.826409:0:21933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00010000:00010000:3.0:1789607806.882036:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789607806.882111:0:21927:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607806.882116:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d77c52a0000 from 13 10000000:01000000:2.0:1789607806.882121:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607806.882167:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf6b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.882178:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf6b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607806.882189:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf6b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607806.882215:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150178560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607806.882282:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607806.882334:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78d32ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789607806.882460:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150178560 00000100:00100000:0.0:1789607806.882468:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150178560 00000100:00100000:0.0:1789607806.882520:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789607806.882539:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+20:21927:x1876539150178560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607806.882552:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607806.882564:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d79018f0800/0xa26202d240fbf6b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf6b0 expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.882596:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d79018f0800/0xa26202d240fbf6b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf6b0 expref: 21 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.882607:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d79018f0800/0xa26202d240fbf6b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf6b0 expref: 21 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.882615:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f0800, rc 0) 00000100:00100000:0.0:1789607806.882668:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+21:21927:x1876539150178560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607806.882674:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789607806.882728:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150178560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607806.882753:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf6b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf6b7 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.882769:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf6b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf6b7 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607806.882824:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150178688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.882856:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607806.882908:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607806.882975:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150178688 00000100:00100000:1.0:1789607806.882980:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150178688 00000100:00100000:1.0:1789607806.883011:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789607806.883019:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:21927:x1876539150178688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607806.883270:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:21927:x1876539150178688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607806.883278:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789607806.883594:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150178688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.883627:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150178816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.883666:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607806.883688:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607806.884061:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150178816 00000100:00100000:2.0:1789607806.884068:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150178816 00000100:00100000:2.0:1789607806.884104:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789607806.884112:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+21:21927:x1876539150178816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607806.884280:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+21:21927:x1876539150178816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607806.884287:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789607806.885694:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150178816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789607806.891429:0:24699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789607806.893419:0:21927:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789607806.893578:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607806.893604:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf6b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf6b7 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.893618:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d78fd59da00/0xa26202d240fbf6b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf6b7 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607806.893630:0:21927:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789607806.893632:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d77c4ba1000 from 13 10000000:01000000:3.0:1789607806.893635:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607806.893677:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbf6be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.893685:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbf6be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.893709:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbf6be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607806.893733:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150178944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.893800:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607806.893837:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607806.894687:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150178944 00000100:00100000:1.0:1789607806.894699:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150178944 00000100:00100000:1.0:1789607806.894842:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789607806.894852:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+21:21927:x1876539150178944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607806.894916:0:21923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607806.894932:0:21923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c5bed800/0xa26202d240fbf6c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf6be expref: -99 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.894958:0:21923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c5bed800/0xa26202d240fbf6c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf6be expref: 22 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.894968:0:21923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c5bed800/0xa26202d240fbf6c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf6be expref: 22 pid: 21923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.894977:0:21923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c5bed800, rc 0) 00000100:00100000:1.0:1789607806.895032:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+22:21927:x1876539150178944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607806.895039:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789607806.895423:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150178944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607806.895443:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbf6be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf6c5 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.895467:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbf6be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf6c5 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607806.895530:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.895564:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607806.895604:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607806.895762:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150179072 00000100:00100000:0.0:1789607806.895769:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150179072 00000100:00100000:0.0:1789607806.895804:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789607806.895812:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78f5693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+22:21927:x1876539150179072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607806.896106:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78f5693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+22:21927:x1876539150179072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607806.896113:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789607806.896257:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.896287:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.896336:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607806.896355:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607806.896662:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150179200 00000100:00100000:2.0:1789607806.896667:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150179200 00000100:00100000:2.0:1789607806.896700:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789607806.896707:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+22:21927:x1876539150179200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607806.896895:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+22:21927:x1876539150179200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607806.896902:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789607806.897400:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789607806.899205:0:24700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789607806.900062:0:21927:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789607806.900085:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607806.900095:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbf6be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf6c5 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.900122:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8e00/0xa26202d240fbf6be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf6c5 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607806.900133:0:21927:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789607806.900136:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d77c610b000 from 13 10000000:01000000:3.0:1789607806.900139:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607806.900173:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbf6cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.900181:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbf6cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.900191:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbf6cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607806.900214:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.900291:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607806.900346:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607806.900472:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150179328 00000100:00100000:1.0:1789607806.900480:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150179328 00000100:00100000:1.0:1789607806.900529:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789607806.900538:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+22:21927:x1876539150179328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607806.900550:0:21924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607806.900572:0:21924:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c5bec000/0xa26202d240fbf6d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf6cc expref: -99 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.900605:0:21924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c5bec000/0xa26202d240fbf6d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf6cc expref: 23 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.900616:0:21924:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c5bec000/0xa26202d240fbf6d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf6cc expref: 23 pid: 21924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.900624:0:21924:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c5bec000, rc 0) 00000100:00100000:1.0:1789607806.900675:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+23:21927:x1876539150179328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607806.900681:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789607806.900900:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607806.900924:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbf6cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf6d3 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.900932:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbf6cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf6d3 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607806.900979:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.901007:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607806.901094:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607806.906725:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150179456 00000100:00100000:1.0:1789607806.906740:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150179456 00000100:00100000:1.0:1789607806.906807:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789607806.906819:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+23:21927:x1876539150179456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607806.907808:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+23:21927:x1876539150179456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 987us (6795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607806.907821:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789607806.907941:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.907990:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.908267:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607806.908347:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607806.908439:0:21924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150179584 00000100:00100000:1.0:1789607806.908560:0:21924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150179584 00000100:00100000:1.0:1789607806.908602:0:21924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789607806.908610:0:21924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+23:21927:x1876539150179584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607806.908813:0:21924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77c69b89-f077-4f20-ab40-68d85082562e+23:21927:x1876539150179584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607806.908821:0:21924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789607806.908906:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789607806.910291:0:24701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789607806.910691:0:21927:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789607806.910710:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607806.910721:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbf6cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf6d3 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.910733:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef8a00/0xa26202d240fbf6cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf6d3 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607806.910744:0:21927:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789607806.910746:0:21927:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d78c2f72000 from 13 10000000:01000000:3.0:1789607806.910749:0:21927:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607806.910781:0:21927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbf6da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.910790:0:21927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbf6da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.910800:0:21927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbf6da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607806.910822:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.910956:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607806.911414:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150179712 00000100:00100000:1.0:1789607806.911422:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150179712 00000100:00100000:1.0:1789607806.911593:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789607806.911604:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+23:21927:x1876539150179712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607806.911618:0:21925:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607806.911632:0:21925:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d78c5bec200/0xa26202d240fbf6e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa26202d240fbf6da expref: -99 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.911656:0:21925:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d78c5bec200/0xa26202d240fbf6e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa26202d240fbf6da expref: 24 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.911673:0:21925:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d78c5bec200/0xa26202d240fbf6e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa26202d240fbf6da expref: 24 pid: 21925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.911680:0:21925:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c5bec200, rc 0) 00000100:00100000:1.0:1789607806.911716:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+24:21927:x1876539150179712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607806.911722:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789607806.913598:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607806.913638:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607806.913661:0:21927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbf6da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf6e1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.913673:0:21927:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbf6da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa26202d240fbf6e1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607806.913748:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.913808:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607806.913896:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607806.914223:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150179840 00000100:00100000:1.0:1789607806.914231:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150179840 00000100:00100000:1.0:1789607806.914283:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789607806.914293:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+24:21927:x1876539150179840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607806.918064:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77c69b89-f077-4f20-ab40-68d85082562e+24:21927:x1876539150179840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3761us (4243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607806.918079:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789607806.920438:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.921241:0:21927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607806.921730:0:21927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607806.921780:0:21927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f0452b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607806.921843:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150179968 00000100:00100000:2.0:1789607806.921851:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150179968 00000100:00100000:2.0:1789607806.921939:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789607806.921952:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+24:21927:x1876539150179968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607806.922151:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+24:21927:x1876539150179968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607806.922209:0:21927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77c69b89-f077-4f20-ab40-68d85082562e:21927:1876539150179968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607806.924204:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000040:00080000:0.0:1789607806.925255:0:24702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789607806.925509:0:21927:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789607806.925529:0:21927:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607806.925540:0:21927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbf6da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf6e1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.925552:0:21927:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.125@tcp lock: ffff8d7900ef9200/0xa26202d240fbf6da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa26202d240fbf6e1 expref: -99 pid: 21927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607806.945349:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.945908:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130149248 00000100:00100000:0.0:1789607806.945919:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130149248 00000100:00100000:0.0:1789607806.946045:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:0.0:1789607806.946055:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+17:19015:x1876539130149248:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:0.0:1789607806.946082:0:21930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607806.946103:0:21930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0000/0xa26202d240fbf6e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f8b expref: -99 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607806.946197:0:21930:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789607806.946313:0:21930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0000/0xa26202d240fbf6e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f8b expref: 19 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.946328:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d78c7c2b200) 00010000:00010000:0.0:1789607806.946331:0:21930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607806.946336:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0000/0xa26202d240fbf6e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f8b expref: 19 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.946348:0:21930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f0000, rc 0) 00000100:00100000:0.0:1789607806.946526:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+18:19015:x1876539130149248:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 472us (1185us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1789607806.946534:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 39 00000100:00100000:2.0:1789607806.949090:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.949171:0:21934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130149504 00000100:00100000:0.0:1789607806.949181:0:21934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130149504 00000100:00100000:0.0:1789607806.949240:0:21934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:0.0:1789607806.949251:0:21934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+18:19015:x1876539130149504:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:0.0:1789607806.949504:0:21934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+19:19015:x1876539130149504:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 254us (422us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1789607806.949528:0:21934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:2.0:1789607806.990282:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607806.990695:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130149760 00000100:00100000:3.0:1789607806.990705:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130149760 00000100:00100000:3.0:1789607806.990953:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:3.0:1789607806.990979:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+19:19018:x1876539130149760:12345-192.168.203.25@tcp:101:lfs.0 00010000:00010000:3.0:1789607806.991004:0:21931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607806.991023:0:21931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf6f6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f92 expref: -99 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.991116:0:21931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf6fd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.991130:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf6fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.991148:0:21931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf6fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607806.991159:0:21931:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789607806.991282:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf6f6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f92 expref: 22 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.991301:0:21931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf6fd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f92 expref: 21 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607806.991310:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:3.0:1789607806.991313:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607806.991316:0:21931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9400, rc 0) 00000100:00100000:3.0:1789607806.991620:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+21:19018:x1876539130149760:12345-192.168.203.25@tcp:101:lfs.0 Request processed in 642us (1347us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1789607806.991628:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 40 00000100:00100000:2.0:1789607806.997666:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607806.997719:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607806.998954:0:21916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130150016 00000100:00100000:0.0:1789607806.998967:0:21916:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130150016 00000100:00100000:0.0:1789607806.999038:0:21916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:0.0:1789607806.999049:0:21916:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+21:2395:x1876539130150016:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607806.999063:0:21916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607806.999089:0:21916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf6fd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f92 expref: 21 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607806.999108:0:21916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:0.0:1789607806.999113:0:21916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607806.999171:0:21916:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+20:2395:x1876539130150016:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 125us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607806.999178:0:21916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:1.0:1789607806.999831:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130149888 00000100:00100000:1.0:1789607806.999838:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130149888 00000100:00100000:1.0:1789607806.999909:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:1.0:1789607806.999918:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+20:19018:x1876539130149888:12345-192.168.203.25@tcp:54:lfs.0 00010000:00010000:1.0:1789607806.999973:0:21932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf70b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607806.999993:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf70b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.000003:0:21932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf70b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.000046:0:21932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf70b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.000053:0:21932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf70b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.000059:0:21932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf70b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.000064:0:21932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bed400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607807.000068:0:21932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf70b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.000075:0:21932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf70b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.000085:0:21932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:1.0:1789607807.000087:0:21932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789607807.000091:0:21932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf70b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.000096:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf70b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607807.000144:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+20:19018:x1876539130149888:12345-192.168.203.25@tcp:54:lfs.0 Request processed in 228us (2488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607807.000152:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 41 00000100:00100000:2.0:1789607807.002573:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607807.002693:0:24698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130150272 00000100:00100000:3.0:1789607807.002701:0:24698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130150272 00000100:00100000:3.0:1789607807.002765:0:24698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:3.0:1789607807.002776:0:24698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+20:19018:x1876539130150272:12345-192.168.203.25@tcp:35:lfs.0 00000100:00100000:3.0:1789607807.003026:0:24698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+21:19018:x1876539130150272:12345-192.168.203.25@tcp:35:lfs.0 Request processed in 250us (464us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1789607807.003033:0:24698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:1.0:1789607807.252926:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607807.253048:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130150528 00000100:00100000:3.0:1789607807.253058:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130150528 00000100:00100000:3.0:1789607807.253127:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:3.0:1789607807.253136:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+21:19049:x1876539130150528:12345-192.168.203.25@tcp:101:cat.0 00010000:00010000:3.0:1789607807.253159:0:23783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607807.253179:0:23783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf712 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668f99 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.253286:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf719 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.253301:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf719 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.253314:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf719 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607807.253325:0:23783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789607807.253467:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf712 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f99 expref: 24 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.253498:0:23783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf719 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f99 expref: 23 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.253525:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:3.0:1789607807.253528:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607807.253531:0:23783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef9400, rc 0) 00000100:00100000:3.0:1789607807.253708:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+23:19049:x1876539130150528:12345-192.168.203.25@tcp:101:cat.0 Request processed in 572us (791us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1789607807.253716:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 42 00000100:00100000:2.0:1789607807.260673:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607807.260732:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607807.261023:0:21917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130150656 00000100:00100000:1.0:1789607807.261034:0:21917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130150656 00000100:00100000:1.0:1789607807.261115:0:21917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:1.0:1789607807.261127:0:21917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+23:2396:x1876539130150656:12345-192.168.203.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789607807.261143:0:21934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130150912 00010000:00010000:1.0:1789607807.261143:0:21917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789607807.261150:0:21934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130150912 00010000:00010000:1.0:1789607807.261170:0:21917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf719 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f99 expref: 24 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.261193:0:21917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:1.0:1789607807.261198:0:21917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607807.261243:0:21934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:1.0:1789607807.261252:0:21917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+23:2396:x1876539130150656:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 126us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607807.261257:0:21934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+23:19049:x1876539130150912:12345-192.168.203.25@tcp:35:cat.0 00000100:00100000:1.0:1789607807.261265:0:21917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:3.0:1789607807.261619:0:21934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+23:19049:x1876539130150912:12345-192.168.203.25@tcp:35:cat.0 Request processed in 367us (898us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1789607807.261626:0:21934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000040:00080000:3.0:1789607807.330533:0:21964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789607807.334506:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607807.334664:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130151168 00000100:00100000:1.0:1789607807.334673:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130151168 00000100:00100000:1.0:1789607807.334743:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:1.0:1789607807.335029:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+23:19055:x1876539130151168:12345-192.168.203.25@tcp:101:dd.0 00010000:00010000:1.0:1789607807.335055:0:21932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607807.335075:0:21932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec800/0xa26202d240fbf727 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668fa0 expref: -99 pid: 21932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.335181:0:21932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed600/0xa26202d240fbf72e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.335198:0:21932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed200/0xa26202d240fbf68d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f6f expref: 24 pid: 21932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.335207:0:21932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec600/0xa26202d240fbf6a9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f84 expref: 24 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.335235:0:21932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed600/0xa26202d240fbf72e lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.335274:0:21932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec600/0xa26202d240fbf6a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f84 expref: 24 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.335288:0:21932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec600/0xa26202d240fbf6a9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f84 expref: 24 pid: 23783 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607807.335302:0:21932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78fa8f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21932:1876539150180096:192.168.203.25@tcp:104: 00010000:00010000:1.0:1789607807.335410:0:21932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed200/0xa26202d240fbf68d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f6f expref: 24 pid: 21932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607807.335421:0:21932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed200/0xa26202d240fbf68d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f6f expref: 24 pid: 21932 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607807.335430:0:21932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c54f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21932:1876539150180224:192.168.203.25@tcp:104: 00000100:00100000:1.0:1789607807.335456:0:21932:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0868b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607807.343387:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607807.343426:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607807.346130:0:21932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78fa8f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21932:1876539150180096:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607807.346148:0:21932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c54f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21932:1876539150180224:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607807.346177:0:21932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed600/0xa26202d240fbf72e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607807.347642:0:21917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130151296 00000100:00100000:3.0:1789607807.347655:0:21917:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130151296 00000100:00100000:2.0:1789607807.347667:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130151424 00000100:00100000:2.0:1789607807.347674:0:21915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130151424 00010000:00010000:2.0:1789607807.347702:0:21915:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed200/0xa26202d240fbf68d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f6f expref: 26 pid: 21932 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607807.347754:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 17 00000100:00100000:2.0:1789607807.347764:0:21915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fd13b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+26:2395:x1876539130151424:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607807.347779:0:21915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607807.347786:0:21915:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed200/0xa26202d240fbf68d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f6f expref: 26 pid: 21932 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607807.347797:0:21915:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed200/0xa26202d240fbf68d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f6f expref: 26 pid: 21932 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607807.347817:0:21915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed200/0xa26202d240fbf68d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f6f expref: 26 pid: 21932 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607807.347833:0:21915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:2.0:1789607807.347838:0:21915:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed600/0xa26202d240fbf72e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607807.347846:0:21915:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed600/0xa26202d240fbf72e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607807.347852:0:21915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607807.347981:0:21915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fd13b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+25:2395:x1876539130151424:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 218us (4553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607807.347989:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 17 00010000:00010000:3.0:1789607807.348077:0:21917:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec600/0xa26202d240fbf6a9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f84 expref: 26 pid: 23783 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607807.348109:0:21917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 18 00000100:00100000:3.0:1789607807.348120:0:21917:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+24:2395:x1876539130151296:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607807.348129:0:21917:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607807.348136:0:21917:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec600/0xa26202d240fbf6a9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f84 expref: 24 pid: 23783 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.348160:0:21917:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec600/0xa26202d240fbf6a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f84 expref: 24 pid: 23783 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.348175:0:21917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec600/0xa26202d240fbf6a9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668f84 expref: 24 pid: 23783 timeout: 812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.348186:0:21917:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:3.0:1789607807.348190:0:21917:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed600/0xa26202d240fbf72e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.348198:0:21917:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed600/0xa26202d240fbf72e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.348207:0:21917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed600/0xa26202d240fbf72e lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.348237:0:21917:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607807.348263:0:21917:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+23:2395:x1876539130151296:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 146us (4887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607807.348269:0:21917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 18 00010000:00010000:2.0:1789607807.351504:0:21932:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed600/0xa26202d240fbf72e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607807.351521:0:21932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed600/0xa26202d240fbf72e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607807.351547:0:21932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789607807.351727:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bec800/0xa26202d240fbf727 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fa0 expref: 24 pid: 21932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607807.351996:0:21932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed600/0xa26202d240fbf72e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fa0 expref: 23 pid: 21932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607807.352007:0:21932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:2.0:1789607807.352010:0:21932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789607807.352014:0:21932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78c5bed600, rc 0) 00000100:00100000:2.0:1789607807.352076:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+23:19055:x1876539130151168:12345-192.168.203.25@tcp:101:dd.0 Request processed in 17053us (17578us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1789607807.352086:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 43 00000100:00100000:1.0:1789607807.357031:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607807.357121:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130151680 00000100:00100000:2.0:1789607807.357132:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130151680 00000100:00100000:2.0:1789607807.357183:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 44 00000100:00100000:2.0:1789607807.357193:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+23:19055:x1876539130151680:12345-192.168.203.25@tcp:36:dd.0 00010000:00010000:2.0:1789607807.357473:0:21931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbf73c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607807.357507:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbf73c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607807.357519:0:21931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbf73c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607807.357597:0:21931:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1789607807.357626:0:21931:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014775608 reply state 00000000b700a76a transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbf73c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607807.357638:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbf73c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607807.357646:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:2.0:1789607807.357649:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789607807.357653:0:21931:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607807.357734:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+26:19055:x1876539130151680:12345-192.168.203.25@tcp:36:dd.0 Request processed in 542us (712us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1789607807.357741:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 44 00000020:00080000:2.0:1789607807.357756:0:21931:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789607807.364616:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607807.364758:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130151808 00000100:00100000:3.0:1789607807.364769:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130151808 00000100:00100000:3.0:1789607807.364831:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:3.0:1789607807.364843:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+26:19055:x1876539130151808:12345-192.168.203.25@tcp:101:dd.0 00010000:00010000:3.0:1789607807.364909:0:21930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607807.364931:0:21930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf743 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668fa7 expref: -99 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.365019:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf743 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fa7 expref: 27 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.365035:0:21930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf743 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fa7 expref: 27 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.365056:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:3.0:1789607807.365060:0:21930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607807.365063:0:21930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8c00, rc 0) 00000100:00100000:3.0:1789607807.365130:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+27:19055:x1876539130151808:12345-192.168.203.25@tcp:101:dd.0 Request processed in 289us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607807.365137:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 45 00000100:00100000:0.0:1789607807.397530:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607807.397919:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130152064 00000100:00100000:2.0:1789607807.397932:0:21915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130152064 00000100:00100000:2.0:1789607807.397995:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:2.0:1789607807.398017:0:21915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+27:19055:x1876539130152064:12345-192.168.203.25@tcp:103:dd.0 00010000:00010000:2.0:1789607807.398208:0:21915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607807.398235:0:21915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf743 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fa7 expref: 27 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607807.398274:0:21915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:2.0:1789607807.398279:0:21915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607807.398339:0:21915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+26:19055:x1876539130152064:12345-192.168.203.25@tcp:103:dd.0 Request processed in 325us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607807.398348:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:1.0:1789607807.403664:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607807.403743:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130152192 00000100:00100000:3.0:1789607807.403755:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130152192 00000100:00100000:3.0:1789607807.403815:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:3.0:1789607807.403826:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+26:19055:x1876539130152192:12345-192.168.203.25@tcp:58:dd.0 00010000:00010000:0.0:1789607807.404222:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf74a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607807.404243:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf74a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607807.404256:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf74a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607807.405360:0:23783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607807.405514:0:23783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1789607807.405608:0:23783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1789607807.406340:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+26:19055:x1876539130152192:12345-192.168.203.25@tcp:58:dd.0 Request processed in 2510us (2679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607807.406351:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 46 00000100:00100000:0.0:1789607807.411522:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607807.411590:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130152320 00000100:00100000:3.0:1789607807.411602:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130152320 00000100:00100000:3.0:1789607807.411665:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 47 00000100:00100000:3.0:1789607807.411676:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+26:19055:x1876539130152320:12345-192.168.203.25@tcp:101:dd.0 00010000:00010000:3.0:1789607807.411700:0:21930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607807.411723:0:21930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf751 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668fae expref: -99 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.411790:0:21930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf74a lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.411817:0:21930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf751 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fae expref: 27 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.411835:0:21930:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf74a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.411848:0:21930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf751 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fae expref: 27 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.411898:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:3.0:1789607807.411901:0:21930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607807.411905:0:21930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf751 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fae expref: 27 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607807.411913:0:21930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7900ef8c00, rc 0) 00000100:00100000:3.0:1789607807.412125:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+27:19055:x1876539130152320:12345-192.168.203.25@tcp:101:dd.0 Request processed in 450us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607807.412132:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 47 00010000:00010000:0.0:1789607807.906150:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607808.230120:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78e9d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150180352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789607808.230199:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607808.230301:0:23249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150180352 00000100:00100000:0.0:1789607808.230309:0:23249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150180352 00000100:00100000:0.0:1789607808.230366:0:23249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789607808.230375:0:23249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150180352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789607808.230410:0:23249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607808.230471:0:23249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3468:x1876539150180352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.230477:0:23249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789607808.230537:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607808.230819:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78e9d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3468:1876539150180352:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1789607808.354388:0:21964:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789607808.354398:0:21964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607808.354438:0:21964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1789607808.354445:0:21964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1789607808.354570:0:21964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b99c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:21964:1876539150180480:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789607808.354690:0:21964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78f04523c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607808.361425:0:21964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b99c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:21964:1876539150180480:192.168.203.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789607808.363113:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607808.365446:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130152448 00000100:00100000:2.0:1789607808.365462:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130152448 00000100:00100000:2.0:1789607808.365619:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00100000:2.0:1789607808.365631:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+27:19056:x1876539130152448:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789607808.365665:0:21931:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789607808.365809:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+27:19056:x1876539130152448:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 174us (2697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607808.365818:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 48 00000100:00080000:3.0:1789607808.367431:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607808.370225:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607808.370965:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130152576 00000100:00100000:2.0:1789607808.370978:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130152576 00000100:00100000:2.0:1789607808.371041:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:2.0:1789607808.371052:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+27:19056:x1876539130152576:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789607808.371123:0:21932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d200/0xa26202d240fbf758 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371152:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d200/0xa26202d240fbf758 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371165:0:21932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d200/0xa26202d240fbf758 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371245:0:21932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf75f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371253:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf75f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371260:0:21932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf75f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371283:0:21932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf766 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371291:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf766 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371296:0:21932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf766 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607808.371332:0:21932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789607808.371335:0:21932:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789607808.371350:0:21932:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf766 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371361:0:21932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d200/0xa26202d240fbf758 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371367:0:21932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d200/0xa26202d240fbf758 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371374:0:21932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d200/0xa26202d240fbf758 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371391:0:21932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59d200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607808.371395:0:21932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d200/0xa26202d240fbf758 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371403:0:21932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d200/0xa26202d240fbf758 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371415:0:21932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78e28a4200) 00010000:00010000:2.0:1789607808.371418:0:21932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607808.371422:0:21932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d200/0xa26202d240fbf758 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371428:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d200/0xa26202d240fbf758 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371443:0:21932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf75f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371449:0:21932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf75f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371454:0:21932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf75f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371459:0:21932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59c200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607808.371461:0:21932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf75f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371467:0:21932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf75f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371485:0:21932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8d78c7c2b300) 00010000:00010000:2.0:1789607808.371487:0:21932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607808.371490:0:21932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf75f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371496:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf75f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371512:0:21932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf766 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371517:0:21932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf766 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371523:0:21932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf766 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371528:0:21932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59d600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607808.371530:0:21932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf766 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371536:0:21932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf766 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371543:0:21932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:2.0:1789607808.371544:0:21932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607808.371548:0:21932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf766 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.371567:0:21932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf766 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607808.373139:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+27:19056:x1876539130152576:12345-192.168.203.25@tcp:34:lhsmtool_posix.0 Request processed in 620us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607808.373161:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 49 00000100:00100000:1.0:1789607808.376357:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607808.376444:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130152832 00000100:00100000:2.0:1789607808.376454:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130152832 00000100:00100000:2.0:1789607808.376514:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:2.0:1789607808.376524:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+27:19056:x1876539130152832:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607808.376545:0:21931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607808.376573:0:21931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59cc00/0xa26202d240fbf76d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668fb5 expref: -99 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.376689:0:21931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf774 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.376705:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf774 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.376716:0:21931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf774 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607808.376728:0:21931:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789607808.376830:0:21931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf774 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.376839:0:21931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf774 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.376846:0:21931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf774 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.376894:0:21931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59c000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:2.0:1789607808.376899:0:21931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf774 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.376907:0:21931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf774 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.376918:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:2.0:1789607808.376921:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789607808.376925:0:21931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf774 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.376930:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf774 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.377197:0:21931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59cc00/0xa26202d240fbf76d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fb5 expref: 29 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.377208:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d78e28a4200) 00010000:00010000:2.0:1789607808.377210:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607808.377214:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59cc00/0xa26202d240fbf76d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fb5 expref: 29 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.377223:0:21931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59cc00, rc 0) 00000100:00100000:2.0:1789607808.377290:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+28:19056:x1876539130152832:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 767us (943us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1789607808.377298:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 50 00000100:00100000:1.0:1789607808.381945:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607808.382256:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130152960 00000100:00100000:3.0:1789607808.382265:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130152960 00000100:00100000:3.0:1789607808.382323:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:3.0:1789607808.382333:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+28:19056:x1876539130152960:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789607808.382368:0:21930:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789607808.382478:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+28:19056:x1876539130152960:12345-192.168.203.25@tcp:53:lhsmtool_posix.0 Request processed in 147us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607808.382486:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 51 00000100:00100000:3.0:1789607808.398560:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607808.404209:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130153216 00000100:00100000:2.0:1789607808.404241:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130153216 00000100:00100000:2.0:1789607808.404361:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:2.0:1789607808.404372:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+28:19056:x1876539130153216:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607808.404394:0:21931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607808.404416:0:21931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59cc00/0xa26202d240fbf782 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668fbc expref: -99 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789607808.405227:0:21931:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:2.0:1789607808.405235:0:21931:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1789607808.405290:0:21931:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1789607808.405552:0:21931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf789 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.405568:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf789 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.405595:0:21931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf789 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.405655:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59cc00/0xa26202d240fbf782 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fbc expref: 31 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.405674:0:21931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf789 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fbc expref: 30 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.405682:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d78c7c2b300) 00010000:00010000:2.0:1789607808.405685:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607808.405689:0:21931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78fd59c000, rc 0) 00000100:00100000:2.0:1789607808.405767:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+30:19056:x1876539130153216:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 1397us (7222us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1789607808.405782:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 52 00000100:00100000:1.0:1789607808.431097:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607808.431189:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130153472 00000100:00100000:3.0:1789607808.431198:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130153472 00000100:00100000:3.0:1789607808.431253:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:3.0:1789607808.431267:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+30:19056:x1876539130153472:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789607808.431328:0:21930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607808.431366:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c000/0xa26202d240fbf789 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fbc expref: 30 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431386:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d78c7c2b300) 00010000:00010000:3.0:1789607808.431397:0:21930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607808.431419:0:21930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf797 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431433:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf797 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431456:0:21930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf797 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431470:0:21930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf79e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x387f2830 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431477:0:21930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf79e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x387f2830 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431483:0:21930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf79e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x387f2830 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431544:0:21930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf797 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431562:0:21930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf797 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431568:0:21930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf797 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431582:0:21930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607808.431587:0:21930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf797 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431595:0:21930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf797 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431603:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:3.0:1789607808.431606:0:21930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607808.431610:0:21930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf797 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431624:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9400/0xa26202d240fbf797 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431649:0:21930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf79e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x387f2830 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431656:0:21930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf79e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x387f2830 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431661:0:21930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf79e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x387f2830 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431667:0:21930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075c200 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:3.0:1789607808.431670:0:21930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf79e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x387f2830 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431676:0:21930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf79e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x387f2830 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431684:0:21930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x387f2830 (ffff8d78d9b83100) 00010000:00010000:3.0:1789607808.431686:0:21930:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607808.431689:0:21930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf79e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x387f2830 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.431694:0:21930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf79e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x387f2830 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607808.431779:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+29:19056:x1876539130153472:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 517us (691us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789607808.431787:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 53 00000100:00100000:1.0:1789607808.436011:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607808.436099:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130153600 00000100:00100000:0.0:1789607808.436112:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130153600 00000100:00100000:0.0:1789607808.436172:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:0.0:1789607808.436183:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+29:19056:x1876539130153600:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607808.436203:0:23783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607808.436225:0:23783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0600/0xa26202d240fbf7a5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668fc3 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.436259:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf7ac lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.436285:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf7ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.436296:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf7ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.436410:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0600/0xa26202d240fbf7a5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fc3 expref: 31 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.436427:0:23783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f0c00/0xa26202d240fbf7ac lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fc3 expref: 30 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.436436:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d78e28a4e00) 00010000:00010000:0.0:1789607808.436439:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789607808.436443:0:23783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f0c00, rc 0) 00000100:00100000:0.0:1789607808.436501:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+30:19056:x1876539130153600:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 319us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.436509:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:0.0:1789607808.457473:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607808.457543:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130153856 00000100:00100000:2.0:1789607808.457552:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130153856 00000100:00100000:2.0:1789607808.457624:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:2.0:1789607808.457635:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+30:19056:x1876539130153856:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789607808.457732:0:21932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf7b3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.457750:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf7b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.457761:0:21932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf7b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607808.458256:0:21932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1789607808.458269:0:21932:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 713415407097ns, next at 714415403971ns, rc = 0 00000004:00010000:0.0:1789607808.458376:0:21932:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee99c631 reply state 00000000496284aa transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf7b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.458390:0:21932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf7b3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.458399:0:21932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d78e28a4e00) 00010000:00010000:0.0:1789607808.458416:0:21932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789607808.458420:0:21932:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789607808.458517:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+32:19056:x1876539130153856:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 883us (1052us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1789607808.458525:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:2.0:1789607808.463976:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607808.464266:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130153984 00000100:00100000:3.0:1789607808.464276:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130153984 00000100:00100000:3.0:1789607808.464342:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:3.0:1789607808.464353:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+32:19056:x1876539130153984:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607808.464378:0:21931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607808.464398:0:21931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf7ba lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668fca expref: -99 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.464457:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf7ba lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fca expref: 33 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.464471:0:21931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf7ba lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fca expref: 33 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.464489:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d78e28a4e00) 00010000:00010000:3.0:1789607808.464492:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607808.464496:0:21931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075c200, rc 0) 00000100:00100000:3.0:1789607808.464562:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+33:19056:x1876539130153984:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 209us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607808.464568:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:1.0:1789607808.474120:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607808.474454:0:23245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130154112 00000100:00100000:3.0:1789607808.474464:0:23245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130154112 00000100:00100000:3.0:1789607808.474538:0:23245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:3.0:1789607808.474551:0:23245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:2395:x1876539130154112:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789607808.474857:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607808.475208:0:23245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:2395:x1876539130154112:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 658us (1096us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1789607808.475217:0:23245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:1.0:1789607808.478076:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607808.478944:0:24698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130154368 00000100:00100000:3.0:1789607808.478958:0:24698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130154368 00000100:00100000:3.0:1789607808.479025:0:24698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:3.0:1789607808.479037:0:24698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+33:19056:x1876539130154368:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789607808.479377:0:24698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+34:19056:x1876539130154368:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 342us (1309us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1789607808.479385:0:24698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:2.0:1789607808.494093:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607808.494337:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130154624 00000100:00100000:3.0:1789607808.494348:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130154624 00000100:00100000:3.0:1789607808.494406:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:3.0:1789607808.494416:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+34:19056:x1876539130154624:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789607808.494527:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+34:19056:x1876539130154624:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 111us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607808.494534:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 57 00000100:00100000:1.0:1789607808.497181:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607808.497271:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130154752 00000100:00100000:3.0:1789607808.497281:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130154752 00000100:00100000:3.0:1789607808.497341:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:3.0:1789607808.497351:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+34:19056:x1876539130154752:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607808.497372:0:21931:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607808.497393:0:21931:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d800/0xa26202d240fbf7c1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668fd1 expref: -99 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.497463:0:21931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ca00/0xa26202d240fbf7c8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.497477:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ca00/0xa26202d240fbf7c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.497507:0:21931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ca00/0xa26202d240fbf7c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607808.497548:0:21931:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789607808.502289:0:21931:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ca00/0xa26202d240fbf7c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.502349:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d800/0xa26202d240fbf7c1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fd1 expref: 36 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.502370:0:21931:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ca00/0xa26202d240fbf7c8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fd1 expref: 35 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.502380:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d78e28a4e00) 00010000:00010000:3.0:1789607808.502383:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789607808.502386:0:21931:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075ca00, rc 0) 00000100:00100000:3.0:1789607808.502465:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+35:19056:x1876539130154752:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 5115us (5294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607808.502474:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 58 00000100:00100000:1.0:1789607808.505677:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607808.505822:0:23852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130154880 00000100:00100000:3.0:1789607808.505833:0:23852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130154880 00000100:00100000:3.0:1789607808.505920:0:23852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:3.0:1789607808.505931:0:23852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+6:2396:x1876539130154880:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607808.505949:0:23852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607808.505971:0:23852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2e73b18/0xa26202d240fbf7cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668fd8 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789607808.506018:0:23852:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab3f81, blocks: 0x1 00010000:00010000:3.0:1789607808.506038:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=713s v=(0 0) 00010000:00010000:3.0:1789607808.506042:0:23852:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607808.506051:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2e73b18/0xa26202d240fbf7cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fd8 expref: 7 pid: 23852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.506071:0:23852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2e73b18/0xa26202d240fbf7cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fd8 expref: 7 pid: 23852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.506083:0:23852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d78e075c600, rc 0) 00000100:00100000:3.0:1789607808.506137:0:23852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:2396:x1876539130154880:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 208us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607808.506144:0:23852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:2.0:1789607808.512441:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607808.512688:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130155136 00000100:00100000:3.0:1789607808.512698:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130155136 00000100:00100000:3.0:1789607808.512767:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:3.0:1789607808.512777:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+35:19056:x1876539130155136:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789607808.512931:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+35:19056:x1876539130155136:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 155us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607808.512938:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 59 00000100:00100000:1.0:1789607808.516965:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607808.517007:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607808.517041:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607808.517072:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607808.517091:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607808.517112:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607808.517129:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607808.517148:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607808.517173:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130155776 00000100:00100000:1.0:1789607808.517182:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130155776 00000100:00100000:1.0:1789607808.517228:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130155392 00000100:00100000:1.0:1789607808.517231:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130155392 00000100:00100000:1.0:1789607808.517242:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130155648 00000100:00100000:1.0:1789607808.517244:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130155648 00000100:00100000:1.0:1789607808.517255:0:21930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130156160 00000100:00100000:1.0:1789607808.517258:0:21930:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130156160 00000100:00100000:1.0:1789607808.517274:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:1.0:1789607808.517283:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84cf179-1248-41a2-8641-5e45322bb8df+5:2394:x1876539130155776:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607808.517352:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84cf179-1248-41a2-8641-5e45322bb8df+5:2394:x1876539130155776:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 70us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607808.517359:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 54 00000100:00100000:1.0:1789607808.517376:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:1.0:1789607808.517396:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:2394:x1876539130155392:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607808.517421:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:2394:x1876539130155392:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 27us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607808.517427:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 55 00000100:00100000:1.0:1789607808.517439:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:1.0:1789607808.517445:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84cf179-1248-41a2-8641-5e45322bb8df+12:2394:x1876539130155648:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:1.0:1789607808.517470:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f84cf179-1248-41a2-8641-5e45322bb8df+12:2394:x1876539130155648:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607808.517476:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 56 00000100:00100000:1.0:1789607808.517487:0:21930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:1.0:1789607808.517493:0:21930:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+35:19056:x1876539130156160:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789607808.517666:0:23246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130155520 00000100:00100000:2.0:1789607808.517670:0:23246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130155520 00000100:00100000:2.0:1789607808.517703:0:23246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130156032 00000100:00100000:2.0:1789607808.517706:0:23246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130156032 00000100:00100000:2.0:1789607808.517725:0:23246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130155904 00000100:00100000:2.0:1789607808.517727:0:23246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130155904 00000100:00100000:2.0:1789607808.517741:0:23246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:2.0:1789607808.517748:0:23246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:2394:x1876539130155520:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607808.517776:0:23246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:2394:x1876539130155520:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 29us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607808.517782:0:23246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 8 00000100:00100000:2.0:1789607808.517817:0:23246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:2.0:1789607808.517825:0:23246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84cf179-1248-41a2-8641-5e45322bb8df+5:2394:x1876539130156032:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607808.517897:0:23246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84cf179-1248-41a2-8641-5e45322bb8df+5:2394:x1876539130156032:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 39us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607808.517904:0:23246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 9 00000100:00100000:2.0:1789607808.517918:0:23246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:2.0:1789607808.517925:0:23246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c54f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84cf179-1248-41a2-8641-5e45322bb8df+5:2394:x1876539130155904:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607808.517948:0:23246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f84cf179-1248-41a2-8641-5e45322bb8df+5:2394:x1876539130155904:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 25us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607808.517953:0:23246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:2.0:1789607808.517978:0:21925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130155264 00000100:00100000:2.0:1789607808.517982:0:21925:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130155264 00000100:00100000:2.0:1789607808.518008:0:21925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 166 00000100:00100000:2.0:1789607808.518014:0:21925:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:2394:x1876539130155264:12345-192.168.203.25@tcp:400:kworker.0 00000100:00100000:2.0:1789607808.518036:0:21925:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6585db7-cc05-4c19-a878-e5ff79e86fce+13:2394:x1876539130155264:12345-192.168.203.25@tcp:400:kworker.0 Request processed in 22us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607808.518042:0:21925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 166 00000100:00080000:0.0:1789607808.518403:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607808.518408:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607808.518411:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607808.518413:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:0.0:1789607808.576123:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901899 is committed 00000001:00080000:0.0:1789607808.576146:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:0.0:1789607808.576165:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901909 is committed 00000004:00080000:0.0:1789607808.576174:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789607808.576202:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00010000:00010000:0.0:1789607808.576247:0:3455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf624 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.576260:0:3455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf624 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.576268:0:3455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf624 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.576275:0:3455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59d400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:0.0:1789607808.576289:0:3455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf624 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.576297:0:3455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf624 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.576312:0:3455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:0.0:1789607808.576330:0:3455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789607808.576336:0:3455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf624 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.576342:0:3455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d400/0xa26202d240fbf624 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576597:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbf5d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576607:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbf5d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576613:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbf5d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576618:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9000 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607808.576621:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbf5d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576626:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbf5d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576645:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d78d9b83300) 00010000:00010000:1.0:1789607808.576648:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607808.576652:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbf5d0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576658:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9000/0xa26202d240fbf5d0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576674:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbf5d7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576680:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbf5d7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576685:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbf5d7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576690:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7900ef9c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607808.576693:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbf5d7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576699:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbf5d7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576706:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d78d9b83000) 00010000:00010000:1.0:1789607808.576709:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607808.576712:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbf5d7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576717:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef9c00/0xa26202d240fbf5d7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576814:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf686 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576821:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf686 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576827:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf686 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576832:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5becc00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607808.576835:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf686 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576840:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf686 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576848:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8d78d3041c00) 00010000:00010000:1.0:1789607808.576851:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607808.576853:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf686 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576859:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf686 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576917:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbf73c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576924:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbf73c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576930:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbf73c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576943:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59de00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607808.576946:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbf73c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576952:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbf73c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576960:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:1.0:1789607808.576962:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607808.576964:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbf73c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576969:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59de00/0xa26202d240fbf73c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576981:0:3454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf7b3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576987:0:3454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf7b3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576993:0:3454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf7b3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.576998:0:3454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59d600 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607808.577000:0:3454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf7b3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.577007:0:3454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf7b3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.577025:0:3454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d78e28a4e00) 00010000:00010000:1.0:1789607808.577027:0:3454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789607808.577031:0:3454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf7b3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.577037:0:3454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59d600/0xa26202d240fbf7b3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607808.577065:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150180608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789607808.577155:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607808.577214:0:23246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150180608 00000100:00100000:1.0:1789607808.577231:0:23246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150180608 00000100:00100000:1.0:1789607808.577352:0:23246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607808.577363:0:23246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150180608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789607808.577527:0:23246:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789607808.577530:0:23246:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789607808.577532:0:23246:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789607808.577534:0:23246:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789607809 -> 1789607809 00002000:00010000:1.0:1789607808.577536:0:23246:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789607808.577900:0:21930:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c54f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+14:19056:x1876539130156160:12345-192.168.203.25@tcp:44:lhsmtool_posix.0 Request processed in 60403us (60747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607808.577911:0:21930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 60 00000100:00100000:1.0:1789607808.577989:0:23246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3469:x1876539150180608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 627us (834us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1789607808.577997:0:23246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789607808.578014:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789607808.578071:0:3469:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d78cffad180/2, rc 0, transno 12884901892 00000100:00100000:0.0:1789607808.578077:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150180608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789607808.580823:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607808.581098:0:23852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130156288 00000100:00100000:2.0:1789607808.581109:0:23852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130156288 00000100:00100000:2.0:1789607808.581164:0:23852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:2.0:1789607808.581175:0:23852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:2395:x1876539130156288:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789607808.581297:0:23852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:2395:x1876539130156288:12345-192.168.203.25@tcp:16:lhsmtool_posix.0 Request processed in 123us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607808.581304:0:23852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 23 00000100:00100000:2.0:1789607808.589723:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607808.589903:0:21931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130156544 00000100:00100000:1.0:1789607808.589913:0:21931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130156544 00000100:00100000:1.0:1789607808.589962:0:21931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:1.0:1789607808.589971:0:21931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+14:19056:x1876539130156544:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607808.590036:0:21931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607808.590062:0:21931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075ca00/0xa26202d240fbf7c8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fd1 expref: 14 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.590082:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d78e28a4e00) 00010000:00010000:1.0:1789607808.590087:0:21931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607808.590115:0:21931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf7d6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.590128:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf7d6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.590137:0:21931:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf7d6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607808.591974:0:21931:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000319dfd0 reply state 0000000081719775 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf7d6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.591998:0:21931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5becc00/0xa26202d240fbf7d6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.592006:0:21931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d78e28a4e00) 00010000:00010000:1.0:1789607808.592009:0:21931:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789607808.592013:0:21931:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607808.592124:0:21931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+15:19056:x1876539130156544:12345-192.168.203.25@tcp:36:lhsmtool_posix.0 Request processed in 2151us (2408us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1789607808.592133:0:21931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 61 00000100:00100000:3.0:1789607808.600830:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607808.601149:0:23245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130156672 00000100:00100000:0.0:1789607808.601159:0:23245:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130156672 00000100:00100000:0.0:1789607808.601216:0:23245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:0.0:1789607808.601227:0:23245:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:19056:x1876539130156672:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607808.601244:0:23245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607808.601264:0:23245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007961e983/0xa26202d240fbf7dd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2e1f40a69e668fdf expref: -99 pid: 23245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.601306:0:23245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2e73b18/0xa26202d240fbf7cf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fd8 expref: 8 pid: 23852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.601316:0:23245:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607808.601320:0:23245:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607808.601325:0:23245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007961e983/0xa26202d240fbf7dd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fdf expref: 8 pid: 23245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.601357:0:23245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2e73b18/0xa26202d240fbf7cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fd8 expref: 8 pid: 23852 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.601383:0:23245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2e73b18/0xa26202d240fbf7cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fd8 expref: 8 pid: 23852 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607808.601396:0:23245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:23245:1876539150180736:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607808.603496:0:23245:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d2180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607808.611194:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607808.611945:0:23245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:23245:1876539150180736:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607808.611981:0:23245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007961e983/0xa26202d240fbf7dd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fdf expref: 8 pid: 23245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.612003:0:23245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d79018f0600, rc 0) 00000100:00100000:0.0:1789607808.612054:0:23245:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+8:19056:x1876539130156672:12345-192.168.203.25@tcp:101:lhsmtool_posix.0 Request processed in 10830us (11233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.612064:0:23245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 24 00000100:00100000:1.0:1789607808.614836:0:21916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130156800 00000100:00100000:1.0:1789607808.614852:0:21916:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130156800 00010000:00010000:1.0:1789607808.614914:0:21916:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2e73b18/0xa26202d240fbf7cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fd8 expref: 8 pid: 23852 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607808.615034:0:21916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:1.0:1789607808.615046:0:21916:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+8:2396:x1876539130156800:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607808.615066:0:21916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607808.615090:0:21916:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2e73b18/0xa26202d240fbf7cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fd8 expref: 8 pid: 23852 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.615104:0:21916:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2e73b18/0xa26202d240fbf7cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fd8 expref: 8 pid: 23852 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.615126:0:21916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2e73b18/0xa26202d240fbf7cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fd8 expref: 8 pid: 23852 timeout: 813 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.615143:0:21916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607808.615147:0:21916:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607808.615154:0:21916:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007961e983/0xa26202d240fbf7dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fdf expref: 7 pid: 23245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.615164:0:21916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007961e983/0xa26202d240fbf7dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fdf expref: 7 pid: 23245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.615214:0:21916:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007961e983/0xa26202d240fbf7dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fdf expref: 7 pid: 23245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607808.615243:0:21916:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:21916:1876539150180864:192.168.203.25@tcp:105: 00000100:00100000:2.0:1789607808.616114:0:21916:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e0868c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607808.618755:0:21916:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:21916:1876539150180864:192.168.203.25@tcp:105: 00010000:00010000:0.0:1789607808.618779:0:21916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607808.618831:0:21916:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:2396:x1876539130156800:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 3787us (7645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.618842:0:21916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 19 00000100:00100000:1.0:1789607808.619669:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607808.619798:0:23244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130156928 00000100:00100000:2.0:1789607808.619805:0:23244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130156928 00000100:00100000:2.0:1789607808.619851:0:23244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:2.0:1789607808.619895:0:23244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:2396:x1876539130156928:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789607808.620085:0:23244:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789607808.620088:0:23244:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789607808 00002000:00010000:2.0:1789607808.620091:0:23244:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789607807 00002000:00010000:2.0:1789607808.620093:0:23244:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789607809 -> 1789607808 00002000:00010000:2.0:1789607808.620095:0:23244:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789607808.620141:0:23244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+8:2396:x1876539130156928:12345-192.168.203.25@tcp:2:lhsmtool_posix.0 Request processed in 281us (474us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789607808.620148:0:23244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 25 00000100:00100000:2.0:1789607808.624248:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607808.624420:0:24107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130157056 00000100:00100000:0.0:1789607808.624432:0:24107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130157056 00000100:00100000:0.0:1789607808.624532:0:24107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:0.0:1789607808.624543:0:24107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2194c24-0745-4580-b5e4-c0f06b3be2e9+8:2396:x1876539130157056:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789607808.624606:0:24107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.624646:0:24107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007961e983/0xa26202d240fbf7dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fdf expref: 8 pid: 23245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.624655:0:24107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607808.624659:0:24107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607808.624664:0:24107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.624709:0:24107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007961e983/0xa26202d240fbf7dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fdf expref: 8 pid: 23245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.624731:0:24107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007961e983/0xa26202d240fbf7dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fdf expref: 8 pid: 23245 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607808.624746:0:24107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78cffad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24107:1876539150180992:192.168.203.25@tcp:104: 00000100:00100000:0.0:1789607808.624831:0:24107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d77c10d2180 going to sleep for 11 seconds 00000100:00100000:0.0:1789607808.628151:0:24107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78cffad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:24107:1876539150180992:192.168.203.25@tcp:104: 00010000:00010000:0.0:1789607808.628184:0:24107:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607808.634370:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607808.634533:0:21915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130157184 00000100:00100000:0.0:1789607808.634543:0:21915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130157184 00010000:00010000:0.0:1789607808.634604:0:21915:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007961e983/0xa26202d240fbf7dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fdf expref: 9 pid: 23245 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607808.634678:0:21915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 20 00000100:00100000:0.0:1789607808.634688:0:21915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+9:2396:x1876539130157184:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607808.634704:0:21915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607808.634737:0:21915:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007961e983/0xa26202d240fbf7dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fdf expref: 9 pid: 23245 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.634750:0:21915:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007961e983/0xa26202d240fbf7dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fdf expref: 9 pid: 23245 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.634773:0:21915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007961e983/0xa26202d240fbf7dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fdf expref: 9 pid: 23245 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.634791:0:21915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607808.634795:0:21915:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607808.634801:0:21915:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.634812:0:21915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.634849:0:21915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607808.634963:0:21915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+8:2396:x1876539130157184:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 275us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.634970:0:21915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 20 00010000:00010000:1.0:1789607808.636634:0:24107:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.636652:0:24107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.636701:0:24107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.636711:0:24107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.636720:0:24107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.636737:0:24107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f1a00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607808.636741:0:24107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.636751:0:24107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.636790:0:24107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.636799:0:24107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf7e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607808.637213:0:24107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:2396:x1876539130157056:12345-192.168.203.25@tcp:1:lhsmtool_posix.0 Request processed in 12667us (12968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607808.637224:0:24107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 26 00000100:00100000:2.0:1789607808.644445:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607808.644837:0:23783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130157440 00000100:00100000:3.0:1789607808.644848:0:23783:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130157440 00000100:00100000:3.0:1789607808.644943:0:23783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 62 00000100:00100000:3.0:1789607808.644954:0:23783:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78e9d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+15:19056:x1876539130157440:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789607808.645034:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d800/0xa26202d240fbf7eb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.645050:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d800/0xa26202d240fbf7eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.645062:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d800/0xa26202d240fbf7eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.645329:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.645341:0:23783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf7ba lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fca expref: 16 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.645350:0:23783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.645388:0:23783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf7ba lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fca expref: 16 pid: 21931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.645402:0:23783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf7ba lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fca expref: 16 pid: 21931 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607808.645416:0:23783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23783:1876539150181120:192.168.203.25@tcp:104: 00000100:00100000:3.0:1789607808.645486:0:23783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e084d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607808.656920:0:23783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23783:1876539150181120:192.168.203.25@tcp:104: 00010000:00010000:3.0:1789607808.656952:0:23783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607808.665046:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607808.665125:0:21916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130157568 00000100:00100000:0.0:1789607808.665134:0:21916:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130157568 00010000:00010000:0.0:1789607808.665178:0:21916:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf7ba lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fca expref: 17 pid: 21931 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607808.665215:0:21916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 21 00000100:00100000:0.0:1789607808.665224:0:21916:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cf7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+17:2395:x1876539130157568:12345-192.168.203.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607808.665239:0:21916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607808.665245:0:21916:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf7ba lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fca expref: 17 pid: 21931 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.665259:0:21916:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf7ba lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fca expref: 17 pid: 21931 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.665279:0:21916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075c200/0xa26202d240fbf7ba lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fca expref: 17 pid: 21931 timeout: 813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.665297:0:21916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d78e28a4e00) 00010000:00010000:0.0:1789607808.665302:0:21916:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.665311:0:21916:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.665319:0:21916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.665349:0:21916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607808.665409:0:21916:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cf7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+16:2395:x1876539130157568:12345-192.168.203.25@tcp:103:ldlm_bl.0 Request processed in 186us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.665431:0:21916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 21 00010000:00010000:3.0:1789607808.667136:0:23783:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.667151:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607808.667349:0:23783:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1789607808.667487:0:23783:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1789607808.667524:0:23783:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1789607808.667637:0:23783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23783:1876539150181248:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789607808.667695:0:23783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607808.667729:0:23783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ec2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607808.668162:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150181248 00000100:00100000:0.0:1789607808.668180:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150181248 00000100:00100000:0.0:1789607808.668226:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789607808.668236:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23783:x1876539150181248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789607808.668318:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23783:x1876539150181248:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.668326:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789607808.668496:0:23783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23783:1876539150181248:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789607808.669497:0:23783:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1789607808.669602:0:23783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23783:1876539150181376:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789607808.669653:0:23783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607808.669780:0:23783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78c3ec2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607808.670689:0:22574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150181376 00000100:00100000:3.0:1789607808.670699:0:22574:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150181376 00000100:00100000:3.0:1789607808.670790:0:22574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607808.670799:0:22574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23783:x1876539150181376:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789607808.671050:0:22574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:23783:x1876539150181376:12345-0@lo:1000:mdt00_003.0 Request processed in 251us (1395us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1789607808.671057:0:22574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789607808.671140:0:23783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b9ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23783:1876539150181376:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789607808.671197:0:23783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671208:0:23783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671217:0:23783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671223:0:23783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075dc00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607808.671228:0:23783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671250:0:23783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671264:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d78e28a4e00) 00010000:00010000:1.0:1789607808.671268:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789607808.671274:0:23783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671280:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075dc00/0xa26202d240fbf7f2 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671314:0:23783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf74a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671321:0:23783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf74a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671327:0:23783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf74a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671332:0:23783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f1c00 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607808.671335:0:23783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf74a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671342:0:23783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf74a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671349:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:1.0:1789607808.671351:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789607808.671358:0:23783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf751 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fae expref: 19 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671385:0:23783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf751 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fae expref: 19 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671408:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf751 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fae expref: 19 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.671444:0:23783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7900ef8c00/0xa26202d240fbf751 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.25@tcp remote: 0x2e1f40a69e668fae expref: 19 pid: 21930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607808.671456:0:23783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23783:1876539150181504:192.168.203.25@tcp:105: 00000100:00100000:1.0:1789607808.671532:0:23783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d78e084d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607808.677619:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607808.677776:0:21934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130157696 00000100:00100000:3.0:1789607808.677786:0:21934:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130157696 00000100:00100000:3.0:1789607808.677839:0:21934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:3.0:1789607808.677850:0:21934:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c415ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+20:19055:x1876539130157696:12345-192.168.203.25@tcp:49:dd.0 00000100:00100000:3.0:1789607808.678005:0:21934:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c415ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2194c24-0745-4580-b5e4-c0f06b3be2e9+20:19055:x1876539130157696:12345-192.168.203.25@tcp:49:dd.0 Request processed in 156us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607808.678027:0:21934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 10 00000100:00100000:1.0:1789607808.678147:0:23783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23783:1876539150181504:192.168.203.25@tcp:105: 00010000:00010000:1.0:1789607808.678188:0:23783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf74a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678198:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d79018f1c00/0xa26202d240fbf74a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678232:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf7f9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678244:0:23783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf7f9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678254:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf7f9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678263:0:23783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf7f9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678277:0:23783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf7f9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678284:0:23783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf7f9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678290:0:23783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bed400 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607808.678294:0:23783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf7f9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678302:0:23783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf7f9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678312:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:1.0:1789607808.678315:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607808.678319:0:23783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf7f9 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678325:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78c5bed400/0xa26202d240fbf7f9 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678335:0:23783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d800/0xa26202d240fbf7eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678341:0:23783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d800/0xa26202d240fbf7eb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678346:0:23783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d800/0xa26202d240fbf7eb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678351:0:23783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075d800 already unused, calling callback (ffffffffc22224f0) 00010000:00010000:1.0:1789607808.678361:0:23783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d800/0xa26202d240fbf7eb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678367:0:23783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d800/0xa26202d240fbf7eb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678376:0:23783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d78d3041f00) 00010000:00010000:1.0:1789607808.678378:0:23783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789607808.678381:0:23783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d800/0xa26202d240fbf7eb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.678387:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78e075d800/0xa26202d240fbf7eb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607808.678585:0:23783:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78e9d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+19:19056:x1876539130157440:12345-192.168.203.25@tcp:57:lhsmtool_posix.0 Request processed in 33623us (34140us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1789607808.678594:0:23783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 62 00000020:00080000:1.0:1789607808.678598:0:23783:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789607808.679131:0:21964:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789607808.679136:0:21964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607808.679159:0:21964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1789607808.679163:0:21964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1789607808.687411:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:3.0:1789607808.687502:0:24698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130157952 00000100:00100000:3.0:1789607808.687512:0:24698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130157952 00000100:00100000:3.0:1789607808.687591:0:24698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 11 00000100:00100000:3.0:1789607808.687602:0:24698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78c6249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+19:19056:x1876539130157952:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789607808.688730:0:24698:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789607808.688823:0:24698:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1789607808.696689:0:24698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf800 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.696713:0:24698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf800 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 24698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.696725:0:24698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf800 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 24698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.696748:0:24698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf800 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 24698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.696755:0:24698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf800 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 24698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.696760:0:24698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf800 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 24698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607808.696836:0:24698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789607808.696989:0:24698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78c6249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+21:19056:x1876539130157952:12345-192.168.203.25@tcp:35:lhsmtool_posix.0 Request processed in 9386us (9583us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1789607808.697000:0:24698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 11 00000020:00080000:2.0:1789607808.697007:0:24698:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789607808.700881:0:21919:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607808.700896:0:21919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf800 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 24698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.700909:0:21919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59c200 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607808.700922:0:21919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf800 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 24698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.700932:0:21919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf800 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 24698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.700951:0:21919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d78e28a4e00) 00010000:00010000:1.0:1789607808.700954:0:21919:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789607808.700978:0:21919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf800 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 24698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.700985:0:21919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d78fd59c200/0xa26202d240fbf800 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 24698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.701005:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607808.701007:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607808.701009:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607808.738488:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150181760:0@lo:400:kworker.0 00000100:00100000:2.0:1789607808.738563:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607808.738605:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150182272:0@lo:400:kworker.0 00000100:00100000:2.0:1789607808.738630:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607808.738647:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150182784:0@lo:400:kworker.0 00000100:00100000:2.0:1789607808.738669:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607808.738692:0:3471:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789607808.738698:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77c69b89-f077-4f20-ab40-68d85082562e:3471:1876539150181632:0@lo:400:kworker.0 00000100:00100000:2.0:1789607808.738725:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607808.738749:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150182144:0@lo:400:kworker.0 00000100:00100000:2.0:1789607808.738771:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607808.738786:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150182656:0@lo:400:kworker.0 00000100:00100000:2.0:1789607808.738818:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607808.738848:0:21923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150181632 00000100:00100000:2.0:1789607808.738856:0:21923:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150181632 00000100:00100000:2.0:1789607808.738926:0:21923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789607808.738935:0:21923:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77c4146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+24:3471:x1876539150181632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607808.738983:0:21923:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77c4146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77c69b89-f077-4f20-ab40-68d85082562e+24:3471:x1876539150181632:12345-0@lo:400:kworker.0 Request processed in 49us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607808.738990:0:21923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789607808.739023:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150181760 00000100:00100000:2.0:1789607808.739028:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150181760 00000100:00100000:2.0:1789607808.739051:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150182144 00000100:00100000:2.0:1789607808.739054:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150182144 00000100:00100000:2.0:1789607808.739067:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789607808.739072:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150181760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607808.739105:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3471:x1876539150181760:12345-0@lo:400:kworker.0 Request processed in 32us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607808.739111:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789607808.739122:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789607808.739127:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150182144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607808.739154:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150182144:12345-0@lo:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607808.739159:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789607808.739188:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77c69b89-f077-4f20-ab40-68d85082562e:3471:1876539150181632:0@lo:400:kworker.0 00000100:00100000:2.0:1789607808.739200:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150182144:0@lo:400:kworker.0 00000100:00100000:2.0:1789607808.739209:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c6248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3471:1876539150181760:0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.739323:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150182784 00000100:00100000:0.0:1789607808.739328:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150182784 00000100:00100000:0.0:1789607808.739373:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150182656 00000100:00100000:0.0:1789607808.739376:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150182656 00000100:00100000:0.0:1789607808.739399:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789607808.739405:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150182784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.739445:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1876539150182784:12345-0@lo:400:kworker.0 Request processed in 40us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.739451:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789607808.739464:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789607808.739470:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150182656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.739497:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1876539150182656:12345-0@lo:400:kworker.0 Request processed in 28us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.739502:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789607808.739524:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150182016:0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.739548:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607808.739565:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150182528:0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.739608:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607808.739621:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789607808.739627:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150181888:0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.739648:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607808.739664:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150182400:0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.739683:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607808.739693:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150182912:0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.739711:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607808.739729:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150182016 00000100:00100000:0.0:1789607808.739732:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150182016 00000100:00100000:0.0:1789607808.739747:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150182528 00000100:00100000:0.0:1789607808.739749:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150182528 00000100:00100000:0.0:1789607808.739760:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150182400 00000100:00100000:0.0:1789607808.739763:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150182400 00000100:00100000:0.0:1789607808.739771:0:21932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150182912 00000100:00100000:0.0:1789607808.739773:0:21932:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150182912 00000100:00100000:0.0:1789607808.739784:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789607808.739790:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150182016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.739824:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3469:x1876539150182016:12345-0@lo:400:kworker.0 Request processed in 34us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.739830:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789607808.739843:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789607808.739849:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78cffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150182528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.739900:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78cffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3469:x1876539150182528:12345-0@lo:400:kworker.0 Request processed in 51us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.739906:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789607808.739918:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789607808.739932:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150182400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.739961:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3469:x1876539150182400:12345-0@lo:400:kworker.0 Request processed in 29us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.739966:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789607808.739978:0:21932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789607808.739984:0:21932:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539150182912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.740008:0:21932:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3469:x1876539150182912:12345-0@lo:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.740014:0:21932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789607808.740032:0:23244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150182272 00000100:00100000:0.0:1789607808.740036:0:23244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150182272 00000100:00100000:0.0:1789607808.740060:0:23244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150181888 00000100:00100000:0.0:1789607808.740063:0:23244:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150181888 00000100:00100000:0.0:1789607808.740083:0:23244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789607808.740089:0:23244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150182272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.740119:0:23244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3471:x1876539150182272:12345-0@lo:400:kworker.0 Request processed in 30us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.740124:0:23244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789607808.740134:0:23244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607808.740140:0:23244:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fa8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150181888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.740163:0:23244:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fa8f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150181888:12345-0@lo:400:kworker.0 Request processed in 24us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.740168:0:23244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789607808.740204:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901b08e00 x1876539150182656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607808.740215:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3471:1876539150182656:0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.740236:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3471:1876539150182272:0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.740246:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3471:1876539150182784:0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.740279:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150181888:0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.740288:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3469:1876539150182400:0@lo:400:kworker.0 00010000:00080000:0.0:1789607808.740297:0:3469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d7901b0a680 x1876539150182912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607808.740305:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3469:1876539150182912:0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.740314:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3469:1876539150182016:0@lo:400:kworker.0 00000100:00100000:0.0:1789607808.740322:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3469:1876539150182528:0@lo:400:kworker.0 00000100:00080000:2.0:1789607808.740638:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607808.740643:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607808.740646:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789607808.740648:0:21926:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607808.740788:0:3468:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607808.740800:0:3468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150183040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607808.740834:0:3468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607808.740889:0:23249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150183040 00000100:00100000:1.0:1789607808.740894:0:23249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150183040 00000100:00100000:1.0:1789607808.740925:0:23249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789607808.740932:0:23249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150183040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607808.740948:0:23249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607808.740986:0:23249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3468:x1876539150183040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607808.740992:0:23249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789607808.741026:0:3468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3468:1876539150183040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607808.744585:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150183168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789607808.744657:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607808.744697:0:3470:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607808.744704:0:3470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d7901b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150183296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607808.744727:0:3470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607808.744896:0:3469:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607808.744907:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150183424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607808.744939:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607808.744990:0:21935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150183424 00000100:00100000:0.0:1789607808.744997:0:21935:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150183424 00000100:00100000:0.0:1789607808.745039:0:21935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789607808.745062:0:21935:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150183424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789607808.745100:0:21935:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789607808.745153:0:21935:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3469:x1876539150183424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.745160:0:21935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789607808.745197:0:3469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150183552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789607808.745234:0:3469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607808.745277:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78c61fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3469:1876539150183424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789607808.745314:0:21936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150183552 00000100:00100000:0.0:1789607808.745318:0:21936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150183552 00000100:00100000:0.0:1789607808.745340:0:21936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789607808.745346:0:21936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150183552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789607808.745366:0:21936:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607808.745402:0:21936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3469:x1876539150183552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607808.745409:0:21936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789607808.745436:0:3469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d78f0703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3469:1876539150183552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789607808.747103:0:23249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150183168 00000100:00100000:1.0:1789607808.747116:0:23249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150183168 00000100:00100000:1.0:1789607808.747156:0:23249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539150183296 00000100:00100000:1.0:1789607808.747160:0:23249:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539150183296 00000100:00100000:1.0:1789607808.747264:0:23249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607808.747274:0:23249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78ff79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150183168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789607808.747389:0:23249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607808.747469:0:23249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78ff79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3470:x1876539150183168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 197us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607808.747489:0:23249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607808.747507:0:23249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607808.747513:0:23249:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3470:x1876539150183296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607808.747667:0:23249:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607808.747775:0:23249:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d78fcd80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3470:x1876539150183296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 262us (3047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607808.747781:0:23249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789607808.749073:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3470:1876539150183296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607808.749094:0:3470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d7901b98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3470:1876539150183168:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789607808.930155:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607808.962442:0:3462:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:1.0:1789607808.963805:0:23250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130158080 00000100:00100000:1.0:1789607808.963817:0:23250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130158080 00000100:00100000:1.0:1789607808.963924:0:23250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 0 00000100:00100000:1.0:1789607808.963936:0:23250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:2393:x1876539130158080:12345-192.168.203.25@tcp:4:dd.0 00002000:00010000:1.0:1789607808.963983:0:23250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aab3f80, atime: 0x6aab3f7f, ctime: 0x6aab3f80, blocks: 0x1 00010000:00010000:1.0:1789607808.963992:0:23250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf807 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.964007:0:23250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=713s v=(0 0) 00010000:00010000:1.0:1789607808.964011:0:23250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607808.964017:0:23250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607808.964029:0:23250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607808.970533:0:3463:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607808.970653:0:23252:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789607808.970662:0:23252:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789607808.971074:0:23252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130158208 00000100:00100000:2.0:1789607808.971085:0:23252:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130158208 00000100:00100000:3.0:1789607808.971595:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:3.0:1789607808.971608:0:24706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+9:2395:x1876539130158208:12345-192.168.203.25@tcp:4:dd.0 00010000:00010000:3.0:1789607808.971644:0:24706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9fced9a/0xa26202d240fbf80e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.971663:0:24706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607808.971669:0:24706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607808.971675:0:24706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9fced9a/0xa26202d240fbf80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607808.971690:0:24706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9fced9a/0xa26202d240fbf80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607808.990319:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:0.0:1789607808.990470:0:23252:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789607808.990481:0:23252:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789607808.990808:0:23252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130158336 00000100:00100000:2.0:1789607808.990817:0:23252:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130158336 00000100:00100000:0.0:1789607808.991295:0:24707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 2 00000100:00100000:0.0:1789607808.991307:0:24707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b2194c24-0745-4580-b5e4-c0f06b3be2e9+11:2394:x1876539130158336:12345-192.168.203.25@tcp:4:dd.0 00010000:00010000:0.0:1789607808.991343:0:24707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf815 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.991369:0:24707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607808.991374:0:24707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607808.991381:0:24707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607808.991395:0:24707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607809.082140:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:3.0:1789607809.082160:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901892 is committed 00000001:00080000:3.0:1789607809.082170:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1789607809.082504:0:23250:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1789607809.082509:0:23250:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1789607808 -> 1789607809 00002000:00010000:2.0:1789607809.082511:0:23250:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1789607809.082525:0:23250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.082538:0:23250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.082557:0:23250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf807 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.082565:0:23250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5bed400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607809.082578:0:23250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf807 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.082588:0:23250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf807 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.082630:0:23250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf807 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.082638:0:23250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9c76f75/0xa26202d240fbf807 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607809.082848:0:23250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+13:2393:x1876539130158080:12345-192.168.203.25@tcp:4:dd.0 Request processed in 118910us (120410us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789607809.082887:0:23250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 0 00000001:00080000:1.0:1789607809.125487:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901897 is committed 00002000:00010000:0.0:1789607809.126784:0:24707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:0.0:1789607809.126802:0:24707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607809.126816:0:24707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607809.126824:0:24707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607809.126830:0:24707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d79018f1a00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:0.0:1789607809.126835:0:24707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607809.126843:0:24707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf815 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607809.126893:0:24707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf815 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607809.126917:0:24707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000185061e5/0xa26202d240fbf815 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607809.127011:0:24707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b2194c24-0745-4580-b5e4-c0f06b3be2e9+7:2394:x1876539130158336:12345-192.168.203.25@tcp:4:dd.0 Request processed in 135701us (136696us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1789607809.127020:0:24707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 2 00010000:00010000:2.0:1789607809.132086:0:24706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9fced9a/0xa26202d240fbf80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.132107:0:24706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9fced9a/0xa26202d240fbf80e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.132116:0:24706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9fced9a/0xa26202d240fbf80e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.132123:0:24706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075d000 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607809.132127:0:24706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9fced9a/0xa26202d240fbf80e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.132136:0:24706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9fced9a/0xa26202d240fbf80e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.132154:0:24706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9fced9a/0xa26202d240fbf80e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.132178:0:24706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9fced9a/0xa26202d240fbf80e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607809.132275:0:24706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:2395:x1876539130158208:12345-192.168.203.25@tcp:4:dd.0 Request processed in 160666us (161747us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1789607809.132284:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 1 00000100:00100000:2.0:1789607809.142692:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607809.142757:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607809.142774:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607809.142795:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607809.142841:0:3461:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.25@tcp (source: 12345-192.168.203.25@tcp) 00000100:00100000:2.0:1789607809.142890:0:23250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130158464 00000100:00100000:2.0:1789607809.142900:0:23250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130158464 00000100:00100000:2.0:1789607809.142953:0:23250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130158720 00000100:00100000:2.0:1789607809.142957:0:23250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130158720 00000100:00100000:2.0:1789607809.142969:0:23250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130158592 00000100:00100000:2.0:1789607809.142971:0:23250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130158592 00000100:00100000:2.0:1789607809.142983:0:23250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130158848 00000100:00100000:2.0:1789607809.142985:0:23250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130158848 00000100:00100000:2.0:1789607809.142996:0:23250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539130158976 00000100:00100000:2.0:1789607809.142998:0:23250:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539130158976 00000100:00100000:2.0:1789607809.143014:0:23250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:2.0:1789607809.143024:0:23250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+9:2396:x1876539130158464:12345-192.168.203.25@tcp:4:dd.0 00002000:00010000:2.0:1789607809.143074:0:23250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 3145728, mtime: 0x6aab3f81, atime: 0x6aab3f7f, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1789607809.143083:0:23250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf2c3eff/0xa26202d240fbf81c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.143114:0:23250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=714s v=(0 0) 00010000:00010000:2.0:1789607809.143119:0:23250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607809.143125:0:23250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2c3eff/0xa26202d240fbf81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.143139:0:23250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf2c3eff/0xa26202d240fbf81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607809.143281:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 4 00000100:00100000:2.0:1789607809.143289:0:24706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+10:2396:x1876539130158720:12345-192.168.203.25@tcp:4:dd.0 00010000:00010000:2.0:1789607809.143305:0:24706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e8d4912/0xa26202d240fbf823 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.143314:0:24706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607809.143317:0:24706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607809.143321:0:24706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e8d4912/0xa26202d240fbf823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607809.143446:0:23252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:3.0:1789607809.143457:0:23252:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+10:2395:x1876539130158592:12345-192.168.203.25@tcp:4:dd.0 00010000:00010000:3.0:1789607809.143473:0:23252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b76d3ce/0xa26202d240fbf82a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.143668:0:24706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e8d4912/0xa26202d240fbf823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607809.146998:0:23252:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607809.147009:0:23252:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607809.147018:0:23252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b76d3ce/0xa26202d240fbf82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607809.147038:0:23252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b76d3ce/0xa26202d240fbf82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789607809.233128:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901898 is committed 00002000:00010000:1.0:1789607809.247141:0:23250:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:1.0:1789607809.247159:0:23250:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:1.0:1789607809.247174:0:23250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf2c3eff/0xa26202d240fbf81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607809.247189:0:23250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2c3eff/0xa26202d240fbf81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607809.247199:0:23250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf2c3eff/0xa26202d240fbf81c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607809.247207:0:23250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59de00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:1.0:1789607809.247212:0:23250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2c3eff/0xa26202d240fbf81c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607809.247222:0:23250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2c3eff/0xa26202d240fbf81c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607809.247243:0:23250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf2c3eff/0xa26202d240fbf81c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607809.247250:0:23250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf2c3eff/0xa26202d240fbf81c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607809.247343:0:23250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+15:2396:x1876539130158464:12345-192.168.203.25@tcp:4:dd.0 Request processed in 104316us (104655us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1789607809.247353:0:23250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 3 00000100:00100000:1.0:1789607809.247386:0:23250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 6 00000100:00100000:1.0:1789607809.247404:0:23250:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+14:2396:x1876539130158848:12345-192.168.203.25@tcp:4:dd.0 00010000:00010000:1.0:1789607809.247435:0:23250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf831 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607809.247447:0:23250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607809.247451:0:23250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607809.247458:0:23250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607809.247470:0:23250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607809.325764:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901900 is committed 00002000:00010000:2.0:1789607809.325853:0:24706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:2.0:1789607809.325889:0:24706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e8d4912/0xa26202d240fbf823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.325918:0:24706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e8d4912/0xa26202d240fbf823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.325926:0:24706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e8d4912/0xa26202d240fbf823 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.325933:0:24706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59d400 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607809.325938:0:24706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e8d4912/0xa26202d240fbf823 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.325948:0:24706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e8d4912/0xa26202d240fbf823 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.325967:0:24706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e8d4912/0xa26202d240fbf823 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.325974:0:24706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e8d4912/0xa26202d240fbf823 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.326055:0:23252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b76d3ce/0xa26202d240fbf82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.326063:0:23252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b76d3ce/0xa26202d240fbf82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.326070:0:23252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b76d3ce/0xa26202d240fbf82a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.326082:0:23252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78e075cc00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607809.326085:0:23252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b76d3ce/0xa26202d240fbf82a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.326093:0:23252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b76d3ce/0xa26202d240fbf82a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.326106:0:23252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b76d3ce/0xa26202d240fbf82a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.326113:0:23252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b76d3ce/0xa26202d240fbf82a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607809.326188:0:23252:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+11:2395:x1876539130158592:12345-192.168.203.25@tcp:4:dd.0 Request processed in 182729us (183407us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1789607809.326197:0:23252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 5 00000100:00100000:2.0:1789607809.326242:0:23252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.25@tcp, seq: 7 00000100:00100000:2.0:1789607809.326252:0:23252:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7901b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+10:2395:x1876539130158976:12345-192.168.203.25@tcp:4:dd.0 00010000:00010000:2.0:1789607809.326279:0:23252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068462d81/0xa26202d240fbf838 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.326290:0:23252:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607809.326294:0:23252:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607809.326299:0:23252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068462d81/0xa26202d240fbf838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.326320:0:23252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068462d81/0xa26202d240fbf838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607809.326673:0:24706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b2194c24-0745-4580-b5e4-c0f06b3be2e9+11:2396:x1876539130158720:12345-192.168.203.25@tcp:4:dd.0 Request processed in 183384us (183913us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1789607809.326681:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 4 00000001:00080000:3.0:1789607809.364621:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901901 is committed 00002000:00010000:2.0:1789607809.367749:0:23250:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1789607809.367759:0:23250:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:2.0:1789607809.367773:0:23250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.367787:0:23250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.367796:0:23250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf831 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.367803:0:23250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78c5beda00 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607809.367807:0:23250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf831 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.367816:0:23250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf831 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.367836:0:23250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf831 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.367853:0:23250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061944e3d/0xa26202d240fbf831 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607809.367968:0:23250:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2194c24-0745-4580-b5e4-c0f06b3be2e9+9:2396:x1876539130158848:12345-192.168.203.25@tcp:4:dd.0 Request processed in 120563us (225165us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1789607809.367977:0:23250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 6 00000001:00080000:1.0:1789607809.404363:0:9077:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901902 is committed 00010000:00010000:2.0:1789607809.404784:0:23252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068462d81/0xa26202d240fbf838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.404799:0:23252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068462d81/0xa26202d240fbf838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.404808:0:23252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068462d81/0xa26202d240fbf838 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.404815:0:23252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d78fd59d600 already unused, calling callback (ffffffffc17c58b0) 00010000:00010000:2.0:1789607809.404819:0:23252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068462d81/0xa26202d240fbf838 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.404828:0:23252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068462d81/0xa26202d240fbf838 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.404848:0:23252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068462d81/0xa26202d240fbf838 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607809.404892:0:23252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068462d81/0xa26202d240fbf838 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607809.404989:0:23252:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7901b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b2194c24-0745-4580-b5e4-c0f06b3be2e9+5:2395:x1876539130158976:12345-192.168.203.25@tcp:4:dd.0 Request processed in 78735us (262143us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1789607809.404999:0:23252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.25@tcp, seq: 7 00010000:00010000:0.0:1789607809.954814:0:21918:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789607810.722681:0:22590:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789607810.978403:0:21919:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789607810.991855:0:24745:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1789607812.002041:0:24106:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14113 lines, 14113 kept, 0 dropped, 0 bad.