00010000:00010000:1.0F:1788791725.155410:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1788791725.348181:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791725.348220:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630489984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791725.348302:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791725.348984:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630489984 00000100:00100000:1.0:1788791725.348993:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630489984 00000100:00100000:1.0:1788791725.349060:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788791725.349070:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630489984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791725.349110:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788791725.349189:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630489984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791725.349196:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0F:1788791725.349536:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788791725.349802:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788791725.349809:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9aba85780e00, transno 8589934595 00000004:00080000:0.0:1788791725.349830:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1788791725.349860:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630489984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788791725.859351:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788791725.859375:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630490112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791725.859442:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791725.859545:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630490112 00000100:00100000:1.0:1788791725.859553:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630490112 00000100:00100000:1.0:1788791725.859617:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788791725.859628:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630490112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788791725.859674:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791725.859720:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630490112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791725.859728:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788791725.859779:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788791725.859810:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630490112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791725.867075:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788791725.867096:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa113159-ee5b-4f24-93ba-c8c094c83d87:3314:1875683630490240:0@lo:400:kworker.0 00000100:00100000:3.0:1788791725.867177:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791725.867225:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630490240 00000100:00100000:3.0:1788791725.867231:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630490240 00000100:00100000:3.0:1788791725.867268:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788791725.867275:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3314:x1875683630490240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791725.867317:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3314:x1875683630490240:12345-0@lo:400:kworker.0 Request processed in 43us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791725.867325:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788791725.867363:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa113159-ee5b-4f24-93ba-c8c094c83d87:3314:1875683630490240:0@lo:400:kworker.0 00000100:00100000:3.0:1788791725.867399:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630490368:0@lo:400:kworker.0 00000100:00100000:3.0:1788791725.867421:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791725.867447:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630490368 00000100:00100000:3.0:1788791725.867450:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630490368 00000100:00100000:3.0:1788791725.867471:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788791725.867477:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630490368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791725.868764:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630490368:12345-0@lo:400:kworker.0 Request processed in 1280us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791725.868776:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788791725.868832:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630490496:0@lo:400:kworker.0 00000100:00100000:3.0:1788791725.868874:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791725.868909:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630490496 00000100:00100000:3.0:1788791725.868914:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630490496 00000100:00100000:3.0:1788791725.868946:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788791725.868954:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630490496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791725.868994:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630490496:12345-0@lo:400:kworker.0 Request processed in 40us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791725.869000:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788791725.869035:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630490496:0@lo:400:kworker.0 00000100:00100000:3.0:1788791725.869073:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630490624:0@lo:400:kworker.0 00000100:00100000:3.0:1788791725.869115:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791725.869162:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630490624 00000100:00100000:3.0:1788791725.869166:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630490624 00000100:00100000:3.0:1788791725.869198:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788791725.869204:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630490624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791725.869250:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630490624:12345-0@lo:400:kworker.0 Request processed in 46us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791725.869257:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788791725.869286:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630490624:0@lo:400:kworker.0 00000100:00080000:3.0:1788791725.869301:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791725.869325:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788791725.869331:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630490752:0@lo:400:kworker.0 00000100:00100000:3.0:1788791725.869352:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791725.869372:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630490752 00000100:00100000:3.0:1788791725.869376:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630490752 00000100:00100000:3.0:1788791725.869399:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788791725.869411:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630490752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791725.869445:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630490752:12345-0@lo:400:kworker.0 Request processed in 35us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791725.869451:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788791725.869474:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630490752:0@lo:400:kworker.0 00000100:00080000:3.0:1788791725.869486:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791725.871062:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630490368:0@lo:400:kworker.0 00000001:00080000:3.0:1788791725.935522:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934619 is committed 00000001:00080000:3.0:1788791725.935541:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000020:00080000:3.0:1788791725.935547:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ab9811f1c00 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:3.0:1788791725.935552:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9aba99374c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ab9811f1540 00000020:00080000:3.0:1788791725.935557:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9aba99374700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9abab31dd800 00000001:00080000:3.0:1788791725.935575:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0F:1788791725.936076:0:14399:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:2.0:1788791725.940110:0:14399:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788791726.179800:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788791727.012455:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788791727.012467:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788791727.012506:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788791727.012512:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788791727.213393:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791727.605997:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791727.606213:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606394240 00000100:00100000:0.0:1788791727.606224:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606394240 00000100:00080000:3.0:1788791727.606510:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791727.606510:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:0.0:1788791727.606528:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+12:14431:x1875683606394240:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788791727.606651:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+12:14431:x1875683606394240:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 Request processed in 128us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791727.606659:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:2.0:1788791727.609848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791727.610471:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606394496 00000100:00100000:1.0:1788791727.610482:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606394496 00000100:00100000:1.0:1788791727.610549:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1788791727.610561:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+12:14431:x1875683606394496:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788791727.618442:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+13:14431:x1875683606394496:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 7872us (8590us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788791727.618457:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1788791728.173756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791728.173818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791728.174041:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606394752 00000100:00100000:2.0:1788791728.174053:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606394752 00000100:00100000:2.0:1788791728.174192:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00080000:0.0:1788791728.174203:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791728.174205:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2353:x1875683606394752:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791728.174294:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2353:x1875683606394752:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 91us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791728.174304:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:3.0:1788791728.174379:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606394624 00000100:00100000:3.0:1788791728.174384:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606394624 00000100:00100000:3.0:1788791728.174420:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:3.0:1788791728.174427:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2353:x1875683606394624:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791728.174455:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2353:x1875683606394624:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 29us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791728.174462:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:3.0:1788791728.184724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791728.184871:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606394880 00000100:00100000:0.0:1788791728.184882:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606394880 00000100:00080000:3.0:1788791728.185101:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788791728.186082:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1788791728.186100:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2351:x1875683606394880:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:0.0:1788791728.186161:0:15043:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a32408b 00000100:00080000:0.0:1788791728.186194:0:15043:0:(import.c:65:import_set_state_nolock()) ffff9abaa9b3e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788791728.186252:0:15043:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:2.0:1788791728.186279:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791728.186576:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+2:2351:x1875683606394880:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 482us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791728.186585:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:2.0:1788791728.187979:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791728.188193:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606395008 00000100:00100000:3.0:1788791728.188202:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606395008 00000100:00100000:3.0:1788791728.188282:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:3.0:1788791728.188305:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2353:x1875683606395008:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791728.188386:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2353:x1875683606395008:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 83us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791728.188393:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00080000:2.0:1788791728.188608:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791728.200475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791728.200518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791728.200616:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606395136 00000100:00100000:3.0:1788791728.200626:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606395136 00000100:00100000:3.0:1788791728.200699:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606395264 00000100:00100000:3.0:1788791728.200702:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606395264 00000100:00100000:3.0:1788791728.200730:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:3.0:1788791728.200740:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2351:x1875683606395136:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:3.0:1788791728.200768:0:15045:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a3240bc 00000100:00080000:3.0:1788791728.200783:0:15045:0:(import.c:65:import_set_state_nolock()) ffff9ababab14800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788791728.200820:0:15045:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:3.0:1788791728.201219:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+2:2351:x1875683606395136:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 478us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791728.201229:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:3.0:1788791728.201246:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:3.0:1788791728.201252:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2351:x1875683606395264:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:3.0:1788791728.201267:0:15045:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a3240c3 00000100:00080000:3.0:1788791728.201273:0:15045:0:(import.c:65:import_set_state_nolock()) ffff9abaa0628000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788791728.201292:0:15045:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788791728.201383:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+2:2351:x1875683606395264:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 131us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791728.201390:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00010000:00010000:2.0:1788791728.202735:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791728.202745:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788791728.202754:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788791728.202759:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788791728.227664:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791729.251303:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791730.280610:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791730.468566:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788791730.468589:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630490880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791730.468654:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791730.468722:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630490880 00000100:00100000:2.0:1788791730.468728:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630490880 00000100:00100000:2.0:1788791730.468775:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788791730.468783:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630490880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788791730.468815:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788791730.468853:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630490880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791730.468859:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788791730.468892:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791730.468923:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630490880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791730.979430:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630491008:0@lo:400:kworker.0 00000100:00100000:1.0:1788791730.979506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791730.979566:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630491520:0@lo:400:kworker.0 00000100:00100000:1.0:1788791730.979611:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791730.979635:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788791730.979641:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630491392:0@lo:400:kworker.0 00000100:00100000:1.0:1788791730.979660:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791730.979686:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630491136:0@lo:400:kworker.0 00000100:00100000:1.0:1788791730.979708:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791730.979724:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630491648:0@lo:400:kworker.0 00000100:00100000:1.0:1788791730.979742:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791730.979760:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791730.979764:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630491264:0@lo:400:kworker.0 00000100:00100000:1.0:1788791730.979786:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791730.979837:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630491008 00000100:00100000:1.0:1788791730.979844:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630491008 00000100:00100000:1.0:1788791730.979889:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788791730.979899:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3313:x1875683630491008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791730.979952:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3313:x1875683630491008:12345-0@lo:400:kworker.0 Request processed in 54us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791730.979959:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788791730.979991:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630491520 00000100:00100000:1.0:1788791730.979995:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630491520 00000100:00100000:1.0:1788791730.980028:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630491392 00000100:00100000:1.0:1788791730.980031:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630491392 00000100:00100000:1.0:1788791730.980044:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630491648 00000100:00100000:1.0:1788791730.980046:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630491648 00000100:00100000:1.0:1788791730.980063:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788791730.980069:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630491520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791730.980099:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630491520:12345-0@lo:400:kworker.0 Request processed in 31us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791730.980112:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788791730.980145:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788791730.980152:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630491392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791730.980183:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630491392:12345-0@lo:400:kworker.0 Request processed in 32us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791730.980189:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788791730.980201:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788791730.980207:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630491648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791730.980239:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630491648:12345-0@lo:400:kworker.0 Request processed in 33us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791730.980246:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788791730.980265:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630491136 00000100:00100000:1.0:1788791730.980268:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630491136 00000100:00100000:1.0:1788791730.980290:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630491264 00000100:00100000:1.0:1788791730.980293:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630491264 00000100:00100000:1.0:1788791730.980312:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788791730.980317:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630491136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791730.980347:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630491136:12345-0@lo:400:kworker.0 Request processed in 29us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791730.980353:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788791730.980364:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788791730.980370:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630491264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791730.980398:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630491264:12345-0@lo:400:kworker.0 Request processed in 29us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791730.980403:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788791730.980434:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788791730.980439:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791730.994063:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630491264:0@lo:400:kworker.0 00000100:00100000:0.0:1788791730.994084:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630491136:0@lo:400:kworker.0 00000100:00100000:0.0:1788791730.994096:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630491648:0@lo:400:kworker.0 00000100:00100000:0.0:1788791730.994149:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788791730.994161:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630491776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791730.994226:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791730.994277:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630491776 00000100:00100000:0.0:1788791730.994283:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630491776 00000100:00100000:0.0:1788791730.994327:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788791730.994335:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630491776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791730.994371:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791730.994415:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630491776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791730.994421:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788791730.994461:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630491392:0@lo:400:kworker.0 00000100:00100000:0.0:1788791730.994472:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630491008:0@lo:400:kworker.0 00000100:00100000:0.0:1788791730.994482:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630491520:0@lo:400:kworker.0 00000100:00100000:0.0:1788791730.994512:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630491776:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788791731.084995:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:0.0:1788791731.085012:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:2.0:1788791731.086582:0:14399:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000020:00080000:2.0:1788791731.086603:0:14399:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000001:00100000:1.0:1788791731.102593:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6788f146-04ff-4ba5-8299-9481a02c8bed 00000020:00000080:1.0:1788791731.102605:0:7644:0:(genops.c:885:class_export_put()) final put ffff9abaa9b3d000/6788f146-04ff-4ba5-8299-9481a02c8bed 00000001:00100000:1.0:1788791731.102626:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ab8deec1-d492-4ec8-be91-5e484d9b7641 00000020:00000080:1.0:1788791731.102628:0:7644:0:(genops.c:885:class_export_put()) final put ffff9ababab16800/ab8deec1-d492-4ec8-be91-5e484d9b7641 00000020:00000080:1.0:1788791731.102644:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa9b3d000/6788f146-04ff-4ba5-8299-9481a02c8bed for lustre-OST0001 00000020:00000080:1.0:1788791731.102688:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababab16800/ab8deec1-d492-4ec8-be91-5e484d9b7641 for lustre-OST0001 00000020:00000080:1.0:1788791731.102706:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abaa9b3e800 for lustre-OST0001 00000020:00000080:1.0:1788791731.102710:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abaa0628000 for lustre-OST0001 00010000:00010000:2.0:1788791731.299259:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788791731.581299:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ab8deec1-d492-4ec8-be91-5e484d9b7641 00000020:00000080:3.0:1788791731.581308:0:6705:0:(genops.c:885:class_export_put()) final put ffff9ababab17000/ab8deec1-d492-4ec8-be91-5e484d9b7641 00000020:00000080:2.0:1788791731.581427:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababab17000/ab8deec1-d492-4ec8-be91-5e484d9b7641 for lustre-OST0000 00000020:00000080:2.0:1788791731.581488:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ababab14800 for lustre-OST0000 00010000:00010000:2.0:1788791732.325050:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791733.295755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791733.295794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791733.295826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791733.295851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791733.295884:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606395648 00000100:00100000:3.0:1788791733.295893:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606395648 00000100:00100000:2.0:1788791733.295903:0:16588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606395520 00000100:00100000:2.0:1788791733.295910:0:16588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606395520 00000100:00100000:2.0:1788791733.295966:0:16588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606395776 00000100:00100000:3.0:1788791733.295971:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788791733.295972:0:16588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606395776 00000100:00100000:3.0:1788791733.295986:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2353:x1875683606395648:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791733.296006:0:16588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:2.0:1788791733.296016:0:16588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6788f146-04ff-4ba5-8299-9481a02c8bed+12:2353:x1875683606395520:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791733.296062:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2353:x1875683606395648:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791733.296064:0:16588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6788f146-04ff-4ba5-8299-9481a02c8bed+12:2353:x1875683606395520:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 48us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791733.296078:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788791733.296080:0:16588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:2.0:1788791733.296103:0:16588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00080000:3.0:1788791733.296105:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788791733.296112:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791733.296112:0:16588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2353:x1875683606395776:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791733.296255:0:16588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2353:x1875683606395776:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 60us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791733.296266:0:16588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:2.0:1788791733.296353:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606395392 00000100:00100000:2.0:1788791733.296358:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606395392 00000100:00100000:2.0:1788791733.296392:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 127 00000100:00100000:2.0:1788791733.296399:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2353:x1875683606395392:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791733.296427:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2353:x1875683606395392:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 27us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791733.296433:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 127 00010000:00010000:1.0:1788791733.347356:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791734.377464:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791735.400883:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791735.588108:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630491904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791735.588202:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791735.588271:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630491904 00000100:00100000:2.0:1788791735.588278:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630491904 00000100:00100000:2.0:1788791735.588329:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788791735.588338:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630491904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788791735.588372:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788791735.588416:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630491904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791735.588423:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788791735.588444:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791735.588492:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630491904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791736.100361:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630492160:0@lo:400:kworker.0 00000100:00100000:1.0:1788791736.100431:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791736.100488:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630492672:0@lo:400:kworker.0 00000100:00100000:1.0:1788791736.100512:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791736.100538:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791736.100543:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630492288:0@lo:400:kworker.0 00000100:00100000:1.0:1788791736.100564:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791736.100601:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630492160 00000100:00100000:1.0:1788791736.100608:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630492160 00000100:00100000:1.0:1788791736.100648:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630492288 00000100:00100000:1.0:1788791736.100651:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630492288 00000100:00100000:1.0:1788791736.100676:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788791736.100683:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630492160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791736.100732:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630492160:12345-0@lo:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791736.100739:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788791736.100767:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788791736.100773:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630492288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791736.100799:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630492288:12345-0@lo:400:kworker.0 Request processed in 27us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791736.100805:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788791736.101068:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630492288:0@lo:400:kworker.0 00000100:00100000:1.0:1788791736.101078:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630492160:0@lo:400:kworker.0 00000100:00100000:3.0:1788791736.102497:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630492672 00000100:00100000:3.0:1788791736.102511:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630492672 00000100:00100000:3.0:1788791736.102625:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788791736.102636:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630492672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791736.102713:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630492672:12345-0@lo:400:kworker.0 Request processed in 80us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791736.102719:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788791736.104172:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630492672:0@lo:400:kworker.0 00000100:00100000:2.0:1788791736.105553:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630492032:0@lo:400:kworker.0 00000100:00100000:2.0:1788791736.105621:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791736.105672:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630492544:0@lo:400:kworker.0 00000100:00100000:2.0:1788791736.105697:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791736.105719:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788791736.105725:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630492416:0@lo:400:kworker.0 00000100:00100000:2.0:1788791736.105742:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788791736.105765:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788791736.105771:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788791736.105791:0:16588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630492544 00000100:00100000:2.0:1788791736.105798:0:16588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630492544 00000100:00100000:2.0:1788791736.105843:0:16588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630492416 00000100:00100000:2.0:1788791736.105846:0:16588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630492416 00000100:00100000:2.0:1788791736.105864:0:16588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788791736.105872:0:16588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630492544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791736.105917:0:16588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630492544:12345-0@lo:400:kworker.0 Request processed in 45us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791736.105924:0:16588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788791736.105939:0:16588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788791736.105944:0:16588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630492416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791736.105965:0:16588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630492416:12345-0@lo:400:kworker.0 Request processed in 22us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791736.105970:0:16588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788791736.105984:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791736.106009:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630492416:0@lo:400:kworker.0 00000100:00100000:2.0:1788791736.106018:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630492544:0@lo:400:kworker.0 00000100:00100000:1.0:1788791736.106206:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630492032 00000100:00100000:1.0:1788791736.106210:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630492032 00000100:00100000:1.0:1788791736.106241:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788791736.106248:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3313:x1875683630492032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791736.106282:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3313:x1875683630492032:12345-0@lo:400:kworker.0 Request processed in 35us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791736.106534:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788791736.106832:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630492800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791736.106868:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791736.110224:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630492800 00000100:00100000:3.0:1788791736.110239:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630492800 00000100:00100000:3.0:1788791736.110310:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788791736.110321:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630492800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788791736.110367:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791736.110451:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630492800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (3582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791736.110470:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788791736.110522:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630492800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791736.110766:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630492032:0@lo:400:kworker.0 00010000:00010000:3.0:1788791736.422462:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788791737.251699:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788791737.251709:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788791737.251744:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788791737.251763:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788791737.443322:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788791738.168178:0:17300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 10:35:36 (1788791736) 00000100:00100000:3.0:1788791738.413015:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791738.413063:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791738.413092:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791738.413120:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791738.413185:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606396032 00000100:00100000:3.0:1788791738.413196:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606396032 00000100:00100000:3.0:1788791738.413254:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606396288 00000100:00100000:3.0:1788791738.413257:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606396288 00000100:00100000:3.0:1788791738.413284:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:3.0:1788791738.413295:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+12:2354:x1875683606396032:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791738.413372:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+12:2354:x1875683606396032:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 79us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791738.413381:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:3.0:1788791738.413398:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:3.0:1788791738.413405:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2354:x1875683606396288:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791738.413442:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2354:x1875683606396288:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 37us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791738.413449:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:3.0:1788791738.413467:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606395904 00000100:00100000:3.0:1788791738.413482:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606395904 00000100:00100000:3.0:1788791738.413509:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:3.0:1788791738.413516:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2354:x1875683606395904:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791738.413541:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2354:x1875683606395904:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791738.413547:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:3.0:1788791738.413574:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606396160 00000100:00100000:3.0:1788791738.413578:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606396160 00000100:00100000:3.0:1788791738.413607:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:3.0:1788791738.413614:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2354:x1875683606396160:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791738.413638:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2354:x1875683606396160:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791738.413645:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00080000:3.0:1788791738.413660:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788791738.413664:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788791738.467481:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791739.491943:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791740.515364:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791740.707517:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788791740.707540:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630492928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788791740.707615:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791740.709077:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630492928 00000100:00100000:0.0:1788791740.709091:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630492928 00000100:00100000:0.0:1788791740.709194:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788791740.709204:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630492928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791740.709246:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788791740.709316:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630492928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791740.709324:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788791740.713235:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791740.716034:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630492928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791741.220435:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788791741.220462:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630493056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791741.220537:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791741.220602:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630493056 00000100:00100000:2.0:1788791741.220610:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630493056 00000100:00100000:2.0:1788791741.220663:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788791741.220672:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630493056:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788791741.220798:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788791741.221058:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791741.221433:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630493056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 760us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791741.221442:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788791741.222693:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630493056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791741.223263:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630493440:0@lo:400:kworker.0 00000100:00100000:3.0:1788791741.223319:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791741.223347:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788791741.223352:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630493568:0@lo:400:kworker.0 00000100:00100000:3.0:1788791741.223383:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791741.223410:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630493440 00000100:00100000:3.0:1788791741.223429:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630493440 00000100:00100000:3.0:1788791741.223486:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630493568 00000100:00100000:3.0:1788791741.223490:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630493568 00000100:00100000:3.0:1788791741.223515:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788791741.223523:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630493440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791741.223570:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630493440:12345-0@lo:400:kworker.0 Request processed in 48us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791741.223577:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788791741.223593:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788791741.223599:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630493568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791741.223625:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630493568:12345-0@lo:400:kworker.0 Request processed in 27us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791741.223631:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788791741.223655:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791741.223686:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630493568:0@lo:400:kworker.0 00000100:00100000:3.0:1788791741.223697:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630493440:0@lo:400:kworker.0 00000100:00100000:1.0:1788791741.224496:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa113159-ee5b-4f24-93ba-c8c094c83d87:3314:1875683630493184:0@lo:400:kworker.0 00000100:00100000:1.0:1788791741.224542:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791741.224579:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791741.224585:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630493312:0@lo:400:kworker.0 00000100:00100000:1.0:1788791741.224619:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791741.224663:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630493312 00000100:00100000:1.0:1788791741.224668:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630493312 00000100:00100000:1.0:1788791741.224702:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788791741.224709:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630493312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791741.224749:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630493312:12345-0@lo:400:kworker.0 Request processed in 40us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791741.224754:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788791741.224786:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630493312:0@lo:400:kworker.0 00000100:00100000:3.0:1788791741.227562:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630493184 00000100:00100000:3.0:1788791741.227576:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630493184 00000100:00100000:3.0:1788791741.227630:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788791741.227640:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3314:x1875683630493184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791741.227724:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3314:x1875683630493184:12345-0@lo:400:kworker.0 Request processed in 85us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791741.227731:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788791741.230273:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa113159-ee5b-4f24-93ba-c8c094c83d87:3314:1875683630493184:0@lo:400:kworker.0 00010000:00010000:2.0:1788791741.539308:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791742.417149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791742.417287:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606396544 00000100:00100000:0.0:1788791742.417298:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606396544 00000100:00100000:0.0:1788791742.417401:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788791742.417413:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+12:15314:x1875683606396544:12345-192.168.201.29@tcp:35:umount.0 00000001:00080000:0.0:1788791742.418016:0:14364:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788791742.418117:0:14364:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00080000:3.0:1788791742.418383:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791742.418487:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+15:15314:x1875683606396544:12345-192.168.201.29@tcp:35:umount.0 Request processed in 1074us (1359us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1788791742.418496:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000020:00080000:0.0:1788791742.418502:0:14364:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788791742.432383:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791742.432428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791742.432492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791742.432526:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606396672 00000100:00100000:3.0:1788791742.432539:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606396672 00000100:00100000:3.0:1788791742.432587:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606396928 00000100:00100000:3.0:1788791742.432590:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606396928 00000100:00100000:3.0:1788791742.432601:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606396800 00000100:00100000:3.0:1788791742.432603:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606396800 00000100:00100000:3.0:1788791742.432618:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1788791742.432628:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+15:2355:x1875683606396672:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791742.432642:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791742.432679:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba851cb000/0xcd6380150a324068 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675350 expref: 15 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791742.432697:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791742.432754:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+14:2355:x1875683606396672:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 127us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791742.432762:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1788791742.432778:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1788791742.432785:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2355:x1875683606396928:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791742.432793:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791742.432803:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba851cb200/0xcd6380150a3240e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367541b expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791742.432812:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791742.432830:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+12:2355:x1875683606396928:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 45us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791742.432836:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1788791742.432849:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788791742.432862:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a02450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:2355:x1875683606396800:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791742.432870:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791742.432879:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81524600/0xcd6380150a32406f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367537a expref: 11 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791742.432889:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791742.432907:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a02450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:2355:x1875683606396800:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 45us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791742.432913:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1788791742.436895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791742.437899:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606397056 00000100:00100000:3.0:1788791742.437910:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606397056 00000100:00100000:3.0:1788791742.437992:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:3.0:1788791742.438002:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2351:x1875683606397056:12345-192.168.201.29@tcp:9:umount.0 00000020:00000080:3.0:1788791742.438038:0:15045:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a324084 00000100:00080000:3.0:1788791742.438047:0:15045:0:(import.c:65:import_set_state_nolock()) ffff9abaa9b3d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788791742.438085:0:15045:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:3.0:1788791742.438382:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+2:2351:x1875683606397056:12345-192.168.201.29@tcp:9:umount.0 Request processed in 380us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791742.438390:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00010000:00010000:3.0:1788791742.438411:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788791742.439504:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788791742.465409:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791742.465481:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606397952 00000100:00100000:0.0:1788791742.465492:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606397952 00000100:00100000:0.0:1788791742.465557:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:0.0:1788791742.465569:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+15:2351:x1875683606397952:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:0.0:1788791742.465620:0:14363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a32407d 00000020:00010000:0.0:1788791742.465639:0:14363:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ab98126f000: total 0 00000100:00080000:0.0:1788791742.465643:0:14363:0:(import.c:65:import_set_state_nolock()) ffff9ab9836a4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788791742.465677:0:14363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:2.0:1788791742.465807:0:14350:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ab98126f000: total 0 00010000:00010000:2.0:1788791742.465877:0:14350:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ab98126f000, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1788791742.465911:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9aba9010c600) 00010000:00010000:2.0:1788791742.465914:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788791742.465922:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a32412c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675422 expref: 15 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791742.465982:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9aba8533fb00) 00010000:00010000:2.0:1788791742.465985:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788791742.465990:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d400/0xcd6380150a324205 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675461 expref: 15 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791742.466006:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:2.0:1788791742.466013:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788791742.466018:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ca00/0xcd6380150a324301 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754ae expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791742.466033:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791742.466036:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788791742.466039:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ce00/0xcd6380150a324283 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367548b expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791742.466051:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791742.466053:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791742.466056:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3242a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675499 expref: 10 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791742.466070:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:2.0:1788791742.466073:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791742.466077:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a324148 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675429 expref: 9 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791742.466089:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba9010c300) 00010000:00010000:2.0:1788791742.466091:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788791742.466095:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324180 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675437 expref: 8 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791742.466105:0:14350:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ab98126f000, canceled 7 locks, left on hash table 0. 00010000:00010000:2.0:1788791742.466124:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791742.466161:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791742.466163:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791742.466292:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+6:2351:x1875683606397952:12345-192.168.201.29@tcp:39:umount.0 Request processed in 725us (893us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1788791742.466301:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00010000:00010000:2.0:1788791742.563309:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791743.533539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791743.533593:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791743.533700:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606398208 00000100:00100000:1.0:1788791743.533716:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606398208 00000100:00100000:3.0:1788791743.533816:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606398080 00000100:00100000:3.0:1788791743.533826:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606398080 00000100:00100000:1.0:1788791743.533898:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:3.0:1788791743.533903:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:3.0:1788791743.533932:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:2354:x1875683606398080:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791743.533934:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2354:x1875683606398208:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791743.534060:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2354:x1875683606398208:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 147us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791743.534070:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:3.0:1788791743.534745:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:2354:x1875683606398080:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 716us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791743.534774:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00080000:0.0:1788791743.538969:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788791743.587895:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791744.612486:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791745.144700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791745.144835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791745.151696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791745.155378:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606398336 00000100:00100000:3.0:1788791745.155412:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606398336 00000100:00100000:2.0:1788791745.159056:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606398592 00000100:00100000:2.0:1788791745.159077:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606398592 00000100:00100000:2.0:1788791745.159206:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1788791745.159219:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:2354:x1875683606398336:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791745.159239:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791745.159268:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16d000/0xcd6380150a3240a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536753b2 expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791745.159292:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791745.159411:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:2354:x1875683606398336:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 195us (14727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791745.159420:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1788791745.159444:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1788791745.159450:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+9:2354:x1875683606398592:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791745.159457:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791745.159467:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb81bc00/0xcd6380150a3240df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675414 expref: 9 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791745.159477:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791745.159496:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+8:2354:x1875683606398592:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 46us (14662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791745.159502:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1788791745.163583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791745.163656:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606398464 00000100:00100000:2.0:1788791745.163670:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606398464 00000100:00100000:3.0:1788791745.163715:0:16588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606398848 00000100:00100000:3.0:1788791745.163730:0:16588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606398848 00000100:00100000:2.0:1788791745.163763:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1788791745.163778:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+8:2354:x1875683606398464:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791745.163823:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791745.163852:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb81be00/0xcd6380150a3240a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536753dc expref: 8 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791745.163876:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791745.163952:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+7:2354:x1875683606398464:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 178us (12271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791745.163966:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00080000:1.0:1788791745.168651:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791745.168773:0:16588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:3.0:1788791745.168797:0:16588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2351:x1875683606398848:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:2.0:1788791745.169804:0:16588:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a3240b5 00000020:00010000:2.0:1788791745.169823:0:16588:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9abab29de000: total 0 00000100:00080000:2.0:1788791745.169830:0:16588:0:(import.c:65:import_set_state_nolock()) ffff9abab29d8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788791745.169875:0:16588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1788791745.170211:0:16588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2351:x1875683606398848:12345-192.168.201.29@tcp:39:umount.0 Request processed in 1420us (6635us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788791745.170224:0:16588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000020:00010000:3.0:1788791745.170920:0:14349:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9abab29de000: total 0 00010000:00010000:3.0:1788791745.170928:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791745.170985:0:14349:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9abab29de000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788791745.171032:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba9010c300) 00010000:00010000:3.0:1788791745.171037:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788791745.171048:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32418e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367543e expref: 4 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791745.171076:0:14349:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9abab29de000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788791745.176875:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791745.176879:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791745.176882:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791745.200467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791745.200758:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606399104 00000100:00100000:3.0:1788791745.200773:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606399104 00000100:00100000:3.0:1788791745.200849:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 132 00000100:00100000:3.0:1788791745.200861:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+7:2351:x1875683606399104:12345-192.168.201.29@tcp:251:umount.0 00000020:00000080:3.0:1788791745.200930:0:14356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a32405a 00000020:00010000:3.0:1788791745.200939:0:14356:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9abaa9b38000: total 0 00000100:00080000:3.0:1788791745.200945:0:14356:0:(import.c:65:import_set_state_nolock()) ffff9abaa9b3a800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788791745.201049:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+3:2351:x1875683606399104:12345-192.168.201.29@tcp:251:umount.0 Request processed in 189us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791745.201075:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 132 00000020:00010000:0.0:1788791745.201364:0:16035:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9abaa9b38000: total 0 00010000:00010000:0.0:1788791745.201425:0:16035:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9abaa9b38000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788791745.201472:0:16035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16c000/0xcd6380150a324061 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675349 expref: 2 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791745.201488:0:16035:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9abaa9b38000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788791745.201499:0:16035:0:(genops.c:885:class_export_put()) final put ffff9abaa9b38000/d5a45585-bfa2-4f9a-ac32-a3df3c538c81 00010000:00010000:0.0:1788791745.201519:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791745.201522:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791745.201524:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788791745.201698:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa9b38000/d5a45585-bfa2-4f9a-ac32-a3df3c538c81 for MGS 00000020:00000080:3.0:1788791745.201748:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abaa9b3a800 for MGS 00010000:00010000:2.0:1788791745.637830:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791745.829918:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630493696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791745.830026:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791745.830155:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630493696 00000100:00100000:1.0:1788791745.830165:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630493696 00000100:00100000:1.0:1788791745.830251:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788791745.830262:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630493696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791745.830318:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788791745.830375:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630493696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791745.830400:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788791745.830428:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791745.830470:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630493696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788791746.341173:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788791746.341197:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630493824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791746.341267:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791746.341519:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630493952:0@lo:400:kworker.0 00000100:00100000:3.0:1788791746.341551:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791746.341576:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788791746.341582:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630494080:0@lo:400:kworker.0 00000100:00100000:3.0:1788791746.341609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791746.341643:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630493952 00000100:00100000:3.0:1788791746.341650:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630493952 00000100:00100000:3.0:1788791746.341693:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788791746.341703:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3312:x1875683630493952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791746.341756:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3312:x1875683630493952:12345-0@lo:400:kworker.0 Request processed in 54us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791746.341762:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788791746.341795:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630494080 00000100:00100000:3.0:1788791746.341799:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630494080 00000100:00100000:3.0:1788791746.341839:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788791746.341845:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630494080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791746.341878:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630494080:12345-0@lo:400:kworker.0 Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791746.341884:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788791746.342271:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630493824 00000100:00100000:0.0:1788791746.342288:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630493824 00000100:00100000:0.0:1788791746.342330:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788791746.342337:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630493824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791746.342372:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791746.342409:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630493824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791746.342418:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788791746.342443:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788791746.342570:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630494080:0@lo:400:kworker.0 00000100:00100000:3.0:1788791746.342580:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630493952:0@lo:400:kworker.0 00000100:00100000:3.0:1788791746.342605:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630494208:0@lo:400:kworker.0 00000100:00100000:3.0:1788791746.342630:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791746.342670:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630493824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791746.342685:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788791746.342690:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630494336:0@lo:400:kworker.0 00000100:00100000:3.0:1788791746.342711:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791746.342736:0:16588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630494208 00000100:00100000:3.0:1788791746.342740:0:16588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630494208 00000100:00100000:3.0:1788791746.342767:0:16588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630494336 00000100:00100000:3.0:1788791746.342770:0:16588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630494336 00000100:00100000:3.0:1788791746.342786:0:16588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788791746.342792:0:16588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630494208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791746.342827:0:16588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630494208:12345-0@lo:400:kworker.0 Request processed in 35us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791746.342833:0:16588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788791746.342845:0:16588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788791746.342851:0:16588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630494336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791746.342875:0:16588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630494336:12345-0@lo:400:kworker.0 Request processed in 25us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791746.342881:0:16588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788791746.343120:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630494336:0@lo:400:kworker.0 00000100:00100000:3.0:1788791746.343151:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630494208:0@lo:400:kworker.0 00000100:00080000:2.0:1788791746.346520:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1788791746.453108:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6788f146-04ff-4ba5-8299-9481a02c8bed 00000001:00080000:0.0:1788791746.453211:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1788791746.453222:0:5859:0:(genops.c:885:class_export_put()) final put ffff9ab98126f000/6788f146-04ff-4ba5-8299-9481a02c8bed 00000001:00100000:0.0:1788791746.453242:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ab8deec1-d492-4ec8-be91-5e484d9b7641 00000001:00080000:0.0:1788791746.453249:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1788791746.453252:0:5859:0:(genops.c:885:class_export_put()) final put ffff9abab29de000/ab8deec1-d492-4ec8-be91-5e484d9b7641 00000020:00000080:1.0:1788791746.453253:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab98126f000/6788f146-04ff-4ba5-8299-9481a02c8bed for lustre-MDT0000 00000020:00000080:1.0:1788791746.453333:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abab29de000/ab8deec1-d492-4ec8-be91-5e484d9b7641 for lustre-MDT0000 00000020:00000080:1.0:1788791746.453388:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ab9836a4800 for lustre-MDT0000 00000020:00000080:1.0:1788791746.453396:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abab29d8000 for lustre-MDT0000 00010000:00010000:0.0:1788791746.660345:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788791746.992462:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6788f146-04ff-4ba5-8299-9481a02c8bed 00000020:00000080:0.0:1788791746.992473:0:6705:0:(genops.c:885:class_export_put()) final put ffff9abaa9b38800/6788f146-04ff-4ba5-8299-9481a02c8bed 00000020:00000080:0.0:1788791746.992525:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa9b38800/6788f146-04ff-4ba5-8299-9481a02c8bed for lustre-OST0000 00000020:00000080:0.0:1788791746.992580:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abaa9b3d800 for lustre-OST0000 00000040:00080000:0.0:1788791747.492372:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788791747.492385:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788791747.492426:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788791747.492434:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000020:01000004:1.0:1788791747.526002:0:17500:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788791747.541414:0:17500:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788791747.541490:0:17500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.541508:0:17500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.541516:0:17500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.541524:0:17500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.541647:0:17500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788791747.541655:0:17500:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788791747.541699:0:17500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788791747.541705:0:17500:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788791747.541714:0:17500:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788791747.541751:0:17500:0:(import.c:65:import_set_state_nolock()) ffff9aba993ab800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788791747.541896:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630494464:0@lo:39:umount.0 00000100:00100000:1.0:1788791747.541989:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791747.542248:0:16588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630494464 00000100:00100000:3.0:1788791747.542269:0:16588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630494464 00000100:00100000:3.0:1788791747.542332:0:16588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788791747.542344:0:16588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875683630494464:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788791747.542376:0:16588:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323dba 00000100:00080000:3.0:1788791747.542387:0:16588:0:(import.c:65:import_set_state_nolock()) ffff9abab29f8000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788791747.542495:0:16035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791747.542505:0:16035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.542515:0:16035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b800 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791747.542520:0:16035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.542553:0:16035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791747.542563:0:16035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791747.542880:0:16035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788791747.542883:0:16035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788791747.542886:0:16035:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788791747.542924:0:16035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.542931:0:16035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788791747.542965:0:16035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.542973:0:16035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.542988:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791747.542990:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791747.542993:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791747.543040:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788791747.543056:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630494592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791747.543113:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791747.543524:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630494592 00000100:00100000:0.0:1788791747.543531:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630494592 00000100:00100000:0.0:1788791747.543727:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788791747.543739:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3313:x1875683630494592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791747.543754:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791747.543775:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb81b000/0xcd6380150a323d90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a323d89 expref: 19 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.543806:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791747.544005:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:3313:x1875683630494592:12345-0@lo:103:ldlm_bl.0 Request processed in 267us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791747.544014:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791747.544324:0:16588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3311:x1875683630494464:12345-0@lo:39:umount.0 Request processed in 1980us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791747.544332:0:16588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00000080:3.0:1788791747.544342:0:16588:0:(genops.c:885:class_export_put()) final put ffff9abab29fc800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1788791747.544447:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9aba993ab800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788791747.544466:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630494464:0@lo:39:umount.0 00000100:00080000:3.0:1788791747.544531:0:17500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788791747.544536:0:17500:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788791747.544542:0:17500:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788791747.545169:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630494592:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788791747.545202:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abab29fc800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788791747.545280:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abab29f8000 for lustre-MDT0000 00010000:00010000:2.0:1788791747.546272:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791747.546462:0:17500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.546479:0:17500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.546486:0:17500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.546493:0:17500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.546639:0:17500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791747.546648:0:17500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.546657:0:17500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.546664:0:17500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.546670:0:17500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.546785:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788791747.546795:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.546803:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16da00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791747.546808:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.546818:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791747.546826:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791747.546831:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788791747.546834:0:14349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788791747.546880:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.546887:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788791747.546920:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.546949:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.546966:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791747.546969:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.546975:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16de00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791747.546979:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.546986:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791747.546993:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791747.546998:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788791747.547000:0:14349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1788791747.547015:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.547021:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788791747.547058:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.547067:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791747.547068:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791747.547070:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791747.547099:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa113159-ee5b-4f24-93ba-c8c094c83d87:3314:1875683630494848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791747.547236:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791747.547323:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630494848 00000100:00100000:0.0:1788791747.547332:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630494848 00000100:00100000:0.0:1788791747.547391:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788791747.547402:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:3314:x1875683630494848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791747.547418:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791747.547436:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba851cb600/0xcd6380150a323f8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a323f88 expref: 18 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.547455:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791747.547494:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:3314:x1875683630494848:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791747.547502:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788791747.547546:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa113159-ee5b-4f24-93ba-c8c094c83d87:3314:1875683630494848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791747.547944:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630494720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791747.547983:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791747.548213:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630494720 00000100:00100000:0.0:1788791747.548221:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630494720 00000100:00100000:0.0:1788791747.548265:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788791747.548275:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:3313:x1875683630494720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791747.548286:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791747.548299:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abab2c00800/0xcd6380150a323cf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a323cef expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.548312:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791747.548354:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:3313:x1875683630494720:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791747.548361:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788791747.548438:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630494720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788791747.548600:0:17500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788791747.548609:0:17500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791747.548636:0:17500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788791747.548646:0:17500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.548655:0:17500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.548662:0:17500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.548670:0:17500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.548834:0:16035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791747.548842:0:16035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.548850:0:16035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791747.548854:0:16035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.548863:0:16035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791747.548870:0:16035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791747.548877:0:16035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788791747.548879:0:16035:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788791747.548906:0:16035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.548913:0:16035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788791747.548973:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa113159-ee5b-4f24-93ba-c8c094c83d87:3315:1875683630494976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791747.549016:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788791747.549169:0:16035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791747.549179:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791747.549181:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791747.549183:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791747.549270:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630494976 00000100:00100000:1.0:1788791747.549277:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630494976 00000100:00100000:1.0:1788791747.549320:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788791747.549328:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab79eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:3315:x1875683630494976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791747.549338:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791747.549351:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81525000/0xcd6380150a324110 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a324109 expref: 16 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791747.549378:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791747.549442:0:17500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788791747.549448:0:17500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791747.549458:0:17500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788791747.549466:0:17500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.549474:0:17500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.549481:0:17500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.549488:0:17500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.549513:0:17500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788791747.549516:0:17500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788791747.549520:0:17500:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788791747.549558:0:17500:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788791747.549563:0:17500:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788791747.549583:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791747.549590:0:17500:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788791747.549596:0:17500:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9abaa70e6000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788791747.549602:0:17500:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9abaa9b39000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788791747.549609:0:17500:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9abab3e3b370) has exports, disconnecting them 00000020:00080000:3.0:1788791747.549615:0:17500:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9abaa70e6000), last request at 1788791746 00000020:00000080:3.0:1788791747.549626:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323f7a 00000100:00080000:3.0:1788791747.549650:0:17500:0:(import.c:65:import_set_state_nolock()) ffff9abaa70e0800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788791747.549722:0:17500:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9abaa70e6000): rc 0 00000020:00000080:3.0:1788791747.549725:0:17500:0:(genops.c:885:class_export_put()) final put ffff9abaa70e6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788791747.549735:0:17500:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9abaa9b39000), last request at 1788791746 00000020:00000080:3.0:1788791747.549738:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323e3f 00000100:00080000:3.0:1788791747.549745:0:17500:0:(import.c:65:import_set_state_nolock()) ffff9aba851e7800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788791747.549753:0:17500:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9abaa9b39000): rc 0 00000020:00000080:3.0:1788791747.549755:0:17500:0:(genops.c:885:class_export_put()) final put ffff9abaa9b39000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788791747.549765:0:17500:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadda439dbae0 00000100:00080000:3.0:1788791747.549792:0:17500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788791747.549796:0:17500:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:3.0:1788791747.549811:0:17500:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788791747.549877:0:17500:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788791747.549898:0:17500:0:(import.c:65:import_set_state_nolock()) ffff9abab306e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788791747.549912:0:17500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788791747.549920:0:17500:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788791747.549929:0:17500:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788791747.549990:0:17500:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788791747.550001:0:17500:0:(import.c:65:import_set_state_nolock()) ffff9ababab12800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788791747.550048:0:17500:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9abab3e3b370) has no exports 00010000:00010000:3.0:1788791747.550354:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791747.550361:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.550370:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16ce00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:3.0:1788791747.550373:0:14350:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.550382:0:14350:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788791747.550390:0:14350:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791747.550396:0:14350:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788791747.550399:0:14350:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788791747.550401:0:14350:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788791747.550427:0:14350:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.550434:0:14350:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788791747.550453:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.550460:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791747.550490:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791747.550491:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791747.550493:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788791747.550577:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa70e6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788791747.550642:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa9b39000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788791747.550673:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abaa70e0800 for lustre-MDT0000 00000020:00000080:0.0:1788791747.550681:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9aba851e7800 for lustre-MDT0000 00010000:00010000:0.0:1788791747.550725:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791747.550751:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630495104:0@lo:9:umount.0 00000100:00100000:0.0:1788791747.550826:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791747.550861:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630495232:0@lo:9:umount.0 00000100:00100000:0.0:1788791747.550887:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791747.550929:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630495104 00000100:00100000:0.0:1788791747.550937:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630495104 00000100:00100000:0.0:1788791747.550992:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630495232 00000100:00100000:0.0:1788791747.550997:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630495232 00000100:00100000:0.0:1788791747.551019:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788791747.551245:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababdbec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875683630495104:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788791747.551286:0:15046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323e5b 00000100:00080000:0.0:1788791747.551295:0:15046:0:(import.c:65:import_set_state_nolock()) ffff9abaa70e1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788791747.551342:0:15046:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:0.0:1788791747.551922:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababdbec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3311:x1875683630495104:12345-0@lo:9:umount.0 Request processed in 892us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791747.551931:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788791747.552239:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788791747.552252:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875683630495232:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788791747.552286:0:15046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323f96 00000100:00080000:0.0:1788791747.552294:0:15046:0:(import.c:65:import_set_state_nolock()) ffff9abaa9b3c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788791747.552325:0:15046:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788791747.552559:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3311:x1875683630495232:12345-0@lo:9:umount.0 Request processed in 311us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791747.552791:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788791747.552823:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788791747.552850:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791747.552858:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791747.552865:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788791747.552927:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9abab306e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788791747.552936:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788791747.552938:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788791747.552943:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630495104:0@lo:9:umount.0 00000100:00080000:0.0:1788791747.552955:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ababab12800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788791747.553008:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788791747.553253:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788791747.553268:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630495232:0@lo:9:umount.0 00000100:00100000:1.0:1788791747.553414:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab79eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:3315:x1875683630494976:12345-0@lo:103:ldlm_bl.0 Request processed in 4084us (4395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791747.553426:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788791747.553532:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa113159-ee5b-4f24-93ba-c8c094c83d87:3315:1875683630494976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791747.553836:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630495360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791747.553889:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791747.554003:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630495360 00000100:00100000:1.0:1788791747.554011:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630495360 00000100:00100000:1.0:1788791747.554080:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788791747.554090:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:3312:x1875683630495360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791747.554105:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791747.554160:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ffc00/0xcd6380150a323ce8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a323ce1 expref: 15 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791747.554181:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791747.554218:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa113159-ee5b-4f24-93ba-c8c094c83d87+14:3312:x1875683630495360:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791747.554224:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788791747.554432:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630495360:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788791747.558830:0:17500:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9abab3e3b370) has no exports 00000020:00000080:3.0:1788791747.601080:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323d3c 00000020:00000080:3.0:1788791747.601097:0:17500:0:(genops.c:885:class_export_put()) final put ffff9aba84cd7000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788791747.601233:0:17500:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788791747.601446:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791747.601466:0:17500:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788791747.601473:0:17500:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9abab3063370) has no exports 00000020:00000080:2.0:1788791747.601879:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323d35 00000020:00000080:2.0:1788791747.601887:0:17500:0:(genops.c:885:class_export_put()) final put ffff9abaa6edb800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788791747.606857:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba84cd7000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788791747.610368:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa6edb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788791747.612565:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791747.612580:0:17500:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788791747.612587:0:17500:0:(genops.c:885:class_export_put()) final put ffff9abaa6edd800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788791747.612591:0:17500:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa6edd800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788791747.612601:0:17500:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788791747.612756:0:17500:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9aba9eda68a0 - data ffff9abaacbda288/ffff9ab982d95400 00000020:01000000:2.0:1788791747.612893:0:17500:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9aba8805eae0 - data ffff9abaacb6f438/ffff9ababdb35800 00000001:00000004:2.0:1788791747.620815:0:17500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00010000:00010000:0.0:1788791747.689524:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788791747.698227:0:17500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788791747.698234:0:17500:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:3.0:1788791747.698247:0:17500:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788791747.698250:0:17500:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788791747.702155:0:14383:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788791747.702163:0:14383:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1788791747.702177:0:14383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788791747.704206:0:17500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788791747.704213:0:17500:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788791747.704232:0:17500:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788791747.704234:0:17500:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788791747.706334:0:14385:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788791747.706352:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1788791747.706367:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788791747.799901:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323d04 00000020:00000080:0.0:1788791747.799913:0:17500:0:(genops.c:885:class_export_put()) final put ffff9abaa0628800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788791747.800435:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa0628800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788791747.801043:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323d19 00000020:00000080:0.0:1788791747.801050:0:17500:0:(genops.c:885:class_export_put()) final put ffff9abac1942000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788791747.801104:0:17500:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788791747.801110:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791747.801119:0:17500:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788791747.801151:0:17500:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9abab3e3cd28) has no exports 00000004:01000000:0.0:1788791747.801351:0:17500:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788791747.801360:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323d66 00000020:00000080:0.0:1788791747.801365:0:17500:0:(genops.c:885:class_export_put()) final put ffff9aba98e4f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788791747.803717:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abac1942000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788791747.804721:0:17500:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788791747.804735:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791747.804746:0:17500:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788791747.804751:0:17500:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9ababc14b370) has no exports 00000020:00000080:0.0:1788791747.804759:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323d5f 00000020:00000080:0.0:1788791747.804767:0:17500:0:(genops.c:885:class_export_put()) final put ffff9abab3069000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788791747.804815:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba98e4f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1788791747.805434:0:17500:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788791747.805439:0:17500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788791747.805453:0:17500:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788791747.805460:0:17500:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788791747.805462:0:17500:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788791747.805513:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abab3069000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788791747.805664:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791747.805671:0:17500:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788791747.805679:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323d51 00000020:00000080:0.0:1788791747.805683:0:17500:0:(genops.c:885:class_export_put()) final put ffff9abaa6edc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788791747.805702:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ababab12800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788791747.805707:0:8:0:(genops.c:885:class_export_put()) final put ffff9abaa6ede800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788791747.805709:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa6ede800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788791747.805713:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788791747.805960:0:17500:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788791747.805966:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791747.805970:0:17500:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788791747.805974:0:17500:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9ababc1499b8) has no exports 00000020:00000080:0.0:1788791747.805978:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323d4a 00000020:00000080:0.0:1788791747.805983:0:17500:0:(genops.c:885:class_export_put()) final put ffff9abab3069800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788791747.805999:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa6edc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1788791747.811865:0:17500:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788791747.811874:0:17500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788791747.811879:0:17500:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:0.0:1788791747.811886:0:17500:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788791747.811889:0:17500:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788791747.812840:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abab3069800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788791747.812963:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791747.812974:0:17500:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788791747.813004:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791747.813007:0:17500:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788791747.813012:0:17500:0:(genops.c:885:class_export_put()) final put ffff9aba851df800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788791747.813015:0:17500:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba851df800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788791747.813021:0:17500:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788791747.813187:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323d20 00000020:00000080:0.0:1788791747.813195:0:17500:0:(genops.c:885:class_export_put()) final put ffff9abac1942800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788791747.813264:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abab306e800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788791747.813338:0:8:0:(genops.c:885:class_export_put()) final put ffff9abaa6ed9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788791747.813409:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa6ed9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788791747.813414:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788791747.813536:0:17500:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788791747.813541:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791747.813547:0:17500:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788791747.813551:0:17500:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9abab3e399b8) has no exports 00000020:00000080:0.0:1788791747.813646:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791747.813656:0:17500:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788791747.813661:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323d27 00000020:00000080:0.0:1788791747.813665:0:17500:0:(genops.c:885:class_export_put()) final put ffff9abac1946800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788791747.813690:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abac1942800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788791747.813695:0:8:0:(genops.c:885:class_export_put()) final put ffff9abaa062f800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788791747.813697:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa062f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788791747.813700:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1788791747.813832:0:17500:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9aba89374800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788791747.813836:0:17500:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9aba89374800 3 00000020:01000004:0.0:1788791747.813839:0:17500:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9aba89374800 from lustre-MDT0000 00000020:00000080:0.0:1788791747.813856:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791747.813860:0:17500:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788791747.813863:0:17500:0:(genops.c:885:class_export_put()) final put ffff9abaa0629000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788791747.813865:0:17500:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa0629000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788791747.813871:0:17500:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788791747.813897:0:17500:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788791747.813900:0:17500:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788791747.813902:0:17500:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788791747.813905:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791747.813907:0:17500:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788791747.813914:0:17500:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9aba88225000 aa113159-ee5b-4f24-93ba-c8c094c83d87 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788791747.813919:0:17500:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9abab3060000) has exports, disconnecting them 00000020:00080000:0.0:1788791747.813923:0:17500:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9aba88225000), last request at 1788791663 00000020:00000080:0.0:1788791747.813937:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323ccc 00000020:00010000:0.0:1788791747.813941:0:17500:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9aba88225000: total 1 00000100:00080000:0.0:1788791747.813945:0:17500:0:(import.c:65:import_set_state_nolock()) ffff9aba88221000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788791747.814007:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abac1946800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:0.0:1788791747.814034:0:17500:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9aba88225000): rc 0 00000020:00080000:0.0:1788791747.814038:0:17500:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9abab3060000) has no exports 00000100:00100000:0.0:1788791747.816673:0:14356:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9aba99376a00:14356] 2 exiting: rc = 0 00000100:00100000:0.0:1788791747.816769:0:14354:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ab98113c600:14354] 0 exiting: rc = 1 00000100:00100000:3.0:1788791747.816858:0:14355:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9aba99377200:14355] 1 exiting: rc = 0 00000020:00010000:1.0:1788791747.817002:0:16035:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9aba88225000: total 0 00010000:00010000:1.0:1788791747.817049:0:16035:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9aba88225000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788791747.817081:0:16035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16c600/0xcd6380150a323df2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a323deb expref: 9 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791747.817101:0:16035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb81a800/0xcd6380150a323e00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a323df9 expref: 8 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791747.817149:0:16035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16c200/0xcd6380150a323e2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a323e23 expref: 7 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791747.817159:0:16035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abab2c00200/0xcd6380150a323f3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a323f34 expref: 6 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791747.817168:0:16035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abab2c00400/0xcd6380150a323cda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a323cd3 expref: 5 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791747.817179:0:16035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb81a200/0xcd6380150a3240f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a3240ed expref: 4 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791747.817187:0:16035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81525600/0xcd6380150a324102 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a3240fb expref: 3 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791747.817200:0:16035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb81a000/0xcd6380150a323f65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a323f5e expref: 2 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791747.817210:0:16035:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9aba88225000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788791747.817224:0:16035:0:(genops.c:885:class_export_put()) final put ffff9aba88225000/aa113159-ee5b-4f24-93ba-c8c094c83d87 00010000:00010000:1.0:1788791747.817238:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791747.817241:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791747.817243:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788791747.817264:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba88225000/aa113159-ee5b-4f24-93ba-c8c094c83d87 for MGS 00000020:00000080:1.0:1788791747.817312:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9aba88221000 for MGS 00000100:00100000:0.0:1788791747.818844:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818853:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818858:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818865:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818871:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818877:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818899:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818905:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818912:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818919:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818924:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818931:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818937:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818943:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818948:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818954:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818959:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818965:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818970:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818978:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818984:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818989:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.818995:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819000:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819006:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819011:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819017:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819021:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819027:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819033:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819039:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819044:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819050:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819057:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819062:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819068:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819075:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819080:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819085:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819090:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819095:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819109:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819114:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.819120:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821535:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821554:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821559:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821642:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821648:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821654:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821661:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821666:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821671:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821676:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821681:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821686:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821691:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821697:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821702:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821709:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821715:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821720:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821726:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791747.821732:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788791747.822223:0:17500:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788791747.822226:0:17500:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788791747.823279:0:17500:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9aba99249ae0 - data ffff9aba9eaba1b0/ffff9ab983316800 00000020:01000000:0.0:1788791747.823638:0:17500:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ab9810c3f60 - data ffff9aba889821b0/ffff9ababc5d3c00 00000020:00000080:0.0:1788791747.824073:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323cb0 00000020:00000080:0.0:1788791747.824081:0:17500:0:(genops.c:885:class_export_put()) final put ffff9aba89373000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788791747.824228:0:17500:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9aba89374800 from MGS, refs=2 00000020:01000004:0.0:1788791747.824232:0:17500:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9aba89374800 2 00000020:01000004:0.0:1788791747.824235:0:17500:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9aba89374800 from MGS 00000020:00000080:0.0:1788791747.824266:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791747.824273:0:17500:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788791747.824299:0:17500:0:(genops.c:885:class_export_put()) final put ffff9aba89370000/MGS 00000020:00000080:0.0:1788791747.824301:0:17500:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba89370000/MGS for MGS 00000020:01000000:0.0:1788791747.824308:0:17500:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788791747.824374:0:17500:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788791747.824379:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791747.824386:0:17500:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788791747.824392:0:17500:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9aba993ad800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788791747.824398:0:17500:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff9aba88c60000) has exports, disconnecting them 00000020:00080000:0.0:1788791747.824403:0:17500:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9aba993ad800), last request at 1788791664 00000020:00000080:0.0:1788791747.824406:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323d9e 00000020:00080000:0.0:1788791747.824416:0:17500:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9aba993ad800): rc 0 00000020:00000080:0.0:1788791747.824420:0:17500:0:(genops.c:885:class_export_put()) final put ffff9aba993ad800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788791747.824664:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba89373000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788791747.825822:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba993ad800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788791747.857208:0:17500:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788791747.857218:0:17500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788791747.857237:0:17500:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788791747.857244:0:17500:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788791747.857404:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9aba993ab800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788791747.857581:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788791747.857590:0:17500:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788791747.857595:0:17500:0:(genops.c:885:class_export_put()) final put ffff9aba851e5800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788791747.857599:0:17500:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba851e5800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788791747.857611:0:17500:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788791747.857669:0:17500:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9aba89374800 1 00000020:00000080:1.0:1788791747.857675:0:17500:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323ca2 00000020:00000080:1.0:1788791747.857680:0:17500:0:(genops.c:885:class_export_put()) final put ffff9aba89376000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788791747.857695:0:17500:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788791747.857700:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788791747.857704:0:17500:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788791747.857707:0:17500:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9abab30619b8) has no exports 00000020:00000080:3.0:1788791747.858517:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba89376000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788791747.896087:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791747.896103:0:17500:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788791747.896108:0:17500:0:(genops.c:885:class_export_put()) final put ffff9aba89376800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788791747.896112:0:17500:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba89376800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788791747.896120:0:17500:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788791747.896270:0:17500:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9aba89372000 00000020:01000000:3.0:1788791747.896288:0:17500:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788791747.896291:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791747.896296:0:17500:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788791747.896299:0:17500:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9abab3064d28) has no exports 00000100:00100000:3.0:1788791747.896366:0:14361:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ababbe77e00:14361] 0 exiting: rc = 1 00000100:00100000:3.0:1788791747.896459:0:16588:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9aba8513de00:16588] 3 exiting: rc = 0 00000100:00100000:1.0:1788791747.899063:0:14362:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9aba9881ce00:14362] 1 exiting: rc = 0 00000100:00100000:0.0:1788791747.900233:0:14363:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ababbe76000:14363] 2 exiting: rc = 0 00000100:00100000:3.0:1788791747.900803:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900810:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900815:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900820:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900825:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900830:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900835:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900850:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900854:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900859:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900868:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900873:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900878:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900884:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900888:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900893:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900898:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900903:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900908:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900912:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900918:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900922:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900927:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900932:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900936:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900940:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900946:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900950:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900955:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900959:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900963:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900968:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900974:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900979:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900983:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900988:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900992:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.900996:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901001:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901006:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901013:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901018:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901028:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901033:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901039:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901045:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901049:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901054:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901059:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901065:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901069:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901074:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901079:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901084:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901089:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901094:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901100:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901105:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901110:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901115:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901120:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901142:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901150:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.901157:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791747.907868:0:14365:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ab981262600:14365] 1 exiting: rc = 0 00000100:00100000:1.0:1788791747.908368:0:14364:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9aba99246a00:14364] 0 exiting: rc = 1 00000100:00100000:3.0:1788791747.908614:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908624:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908631:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908635:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908640:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908646:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908651:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908656:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908662:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908667:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908673:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908679:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908684:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908702:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908707:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908712:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908717:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908723:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908728:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908734:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908744:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908750:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908756:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908761:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908766:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908771:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908777:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908783:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908788:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908793:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908798:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908803:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908884:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908891:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908896:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908902:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908908:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908913:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908918:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908923:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908929:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908934:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908940:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908945:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908950:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908954:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908959:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908964:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908976:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908981:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908987:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908993:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.908997:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.909003:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.909008:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.909013:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.909019:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.909024:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.909030:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.909034:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.909040:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.909045:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.909049:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.909054:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791747.911165:0:14367:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ab981263000:14367] 1 exiting: rc = 0 00000100:00100000:3.0:1788791747.911438:0:14366:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ab981262c00:14366] 0 exiting: rc = 1 00000100:00100000:3.0:1788791747.911511:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911521:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911527:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911533:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911539:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911725:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911734:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911740:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911747:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911754:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911761:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911768:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911774:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911781:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911786:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911793:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911798:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911819:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911836:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911841:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911847:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911854:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911860:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911866:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911872:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911878:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911884:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911891:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911898:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911917:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911924:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911930:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911937:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911943:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911950:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911956:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911964:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911971:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911977:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911984:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.911991:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912011:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912019:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912026:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912034:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912040:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912047:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912052:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912058:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912064:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912071:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912077:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912083:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912109:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912116:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912122:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912168:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912175:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912181:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912187:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912194:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912201:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912207:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.912214:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.920787:0:14369:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ab981262e00:14369] 1 exiting: rc = 0 00000100:00100000:2.0:1788791747.924467:0:14368:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9aba99247200:14368] 0 exiting: rc = 1 00000100:00100000:3.0:1788791747.926372:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926382:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926386:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926391:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926397:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926401:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926406:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926412:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926416:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926421:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926427:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926431:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926436:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926441:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926445:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926451:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926455:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926460:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926464:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926469:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926473:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926478:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926483:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926498:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926503:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926509:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926513:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926517:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926522:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926527:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926532:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926536:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926540:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926544:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926548:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926553:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.926559:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927172:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927182:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927188:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927193:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927198:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927204:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927210:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927216:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927221:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927226:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927232:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927237:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927243:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927259:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927266:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927271:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927276:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927281:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927287:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927292:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927297:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927313:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927318:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927323:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927329:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927334:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927396:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.927846:0:14371:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9aba85142e00:14371] 1 exiting: rc = 0 00000100:00100000:2.0:1788791747.929550:0:14370:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ab981874600:14370] 0 exiting: rc = 1 00000100:00100000:3.0:1788791747.930123:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930151:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930157:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930162:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930168:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930173:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930178:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930183:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930189:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930200:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930205:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930211:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930217:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930222:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930227:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930232:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930237:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930243:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930258:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930265:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930270:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930275:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930281:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930286:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930292:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930297:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930302:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930308:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930325:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930331:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930407:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930416:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930421:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930426:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930431:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930437:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930442:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930448:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930453:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930459:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930464:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930470:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930475:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930481:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930486:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930492:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930497:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930502:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930508:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930513:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930518:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930524:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930529:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930534:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930540:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930545:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930550:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930555:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930678:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930687:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930693:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930698:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930704:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.930716:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791747.931435:0:14373:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9aba85143600:14373] 1 exiting: rc = 0 00000100:00100000:3.0:1788791747.931741:0:14372:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9aba863b0c00:14372] 0 exiting: rc = 1 00000100:00100000:3.0:1788791747.931794:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931800:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931805:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931810:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931815:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931820:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931825:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931831:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931835:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931840:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931846:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931850:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931855:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931861:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931866:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931871:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931876:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931881:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931886:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931891:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931897:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931901:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931906:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931912:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931916:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931921:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931927:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931932:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931937:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931941:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931947:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931952:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931957:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931974:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931979:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931985:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931990:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.931996:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932001:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932006:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932011:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932017:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932022:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932030:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932035:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932039:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932044:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932049:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932055:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932060:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932066:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932071:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932076:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932081:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932086:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932092:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932097:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932103:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932107:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932113:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932118:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.932123:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.933282:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.933289:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.934257:0:14375:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9aba85143a00:14375] 1 exiting: rc = 0 00000100:00100000:1.0:1788791747.934520:0:14374:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9aba863b1000:14374] 0 exiting: rc = 1 00000100:00100000:2.0:1788791747.937315:0:14376:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9aba862dea00:14376] 2 exiting: rc = 0 00000100:00100000:3.0:1788791747.937902:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.937911:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.937917:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.937935:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.937940:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.937947:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.937952:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.937960:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.937968:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.937974:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.937981:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.937987:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.937994:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938000:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938006:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938011:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938018:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938024:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938036:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938045:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938051:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938080:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938087:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938093:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938109:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938168:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938177:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938184:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938189:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938195:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938201:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938207:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938213:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938218:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938224:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938230:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938238:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938244:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938269:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938274:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938281:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938287:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938292:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938298:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938304:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938330:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938337:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938343:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938349:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938354:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938359:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938365:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938370:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938375:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938380:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938386:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938391:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938396:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938402:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938406:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938412:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938417:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938422:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791747.938437:0:17500:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788791747.944996:0:17500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791747.945010:0:17500:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788791747.945015:0:17500:0:(genops.c:885:class_export_put()) final put ffff9aba98aa8000/MDS_uuid 00000020:00000080:3.0:1788791747.945019:0:17500:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba98aa8000/MDS_uuid for MDS 00000020:01000000:3.0:1788791747.945024:0:17500:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788791747.945406:0:17500:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788791748.707358:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791749.731359:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791750.756661:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788791751.288096:0:17649:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788791751.311336:0:17649:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788791751.311385:0:17649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791751.311414:0:17649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791751.311423:0:17649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791751.311430:0:17649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791751.311455:0:17649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788791751.311461:0:17649:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788791751.312704:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791751.312713:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791751.312724:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe600 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791751.312728:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791751.312738:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791751.312745:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791751.312751:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788791751.312768:0:14349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788791751.312771:0:14349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788791751.312815:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791751.312822:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788791751.312851:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791751.312859:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791751.312873:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791751.312875:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791751.312877:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791751.312888:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791751.312908:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630495488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791751.312973:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791751.313072:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630495488 00000100:00100000:0.0:1788791751.313078:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630495488 00000100:00100000:0.0:1788791751.313119:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788791751.313144:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3312:x1875683630495488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788791751.313151:0:14346:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788791751 with bad export cookie 14799813628323314892 00000100:00080000:3.0:1788791751.313713:0:17649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788791751.313716:0:17649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788791751.313722:0:17649:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788791751.313740:0:17649:0:(import.c:65:import_set_state_nolock()) ffff9abaa9b3f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788791751.313796:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875683630495616:0@lo:39:umount.0 00000400:00000100:2.0:1788791751.313826:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683630495616 offset 0 length 224: 4 00000100:00100000:1.0:1788791751.325666:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3312:x1875683630495488:12345-0@lo:103:ldlm_bl.0 Request processed in 12529us (12682us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788791751.325682:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788791751.325720:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788791751.325725:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9ab9819fa800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788791751.325729:0:3312:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788791751.337684:0:3312:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.129@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788791751.337691:0:3312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788791751.337703:0:3312:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ababbfda680 x1875683630495488/t0(0) o103->MGC192.168.201.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788791767 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788791751.337720:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788791751.337724:0:3312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788791751.337750:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788791751.337754:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9ab9819fa800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788791751.337760:0:3312:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 440 00000100:00080000:2.0:1788791751.337771:0:3312:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9ab9819fa800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788791751.337841:0:3312:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb712300 x1875683630495744/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788791751.337914:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa113159-ee5b-4f24-93ba-c8c094c83d87:3311:1875683630495744:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788791751.337968:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875683630495744 offset 0 length 520: 4 00000100:00100000:2.0:1788791751.338039:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630495488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791751.464851:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788791751.464877:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630495872:0@lo:400:kworker.0 00000400:00000100:2.0:1788791751.464934:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683630495872 offset 0 length 224: 4 00000001:00100000:1.0:1788791751.538089:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788791751.538101:0:7644:0:(genops.c:885:class_export_put()) final put ffff9abaa9b39800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788791751.538459:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa9b39800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788791751.538517:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abaa9b3c000 for lustre-OST0001 00010000:00010000:0.0:1788791751.779392:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788791752.084237:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788791752.084249:0:6705:0:(genops.c:885:class_export_put()) final put ffff9abaa70e4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788791752.084874:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa70e4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788791752.084931:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abaa70e1800 for lustre-OST0000 00010000:00010000:0.0:1788791752.803881:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791753.828306:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791754.854289:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791755.875351:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788791756.580536:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) aa113159-ee5b-4f24-93ba-c8c094c83d87->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788791756.580547:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) aa113159-ee5b-4f24-93ba-c8c094c83d87->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788791756.580696:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630496000:0@lo:400:kworker.0 00000400:00000100:2.0:1788791756.580751:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683630496000 offset 0 length 224: 4 00010000:00010000:0.0:1788791756.899518:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791757.923344:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791758.947384:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791759.971873:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791760.998100:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791761.699318:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791751/real 1788791751] req@ffff9ababb712300 x1875683630495744/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788791761 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791761.699366:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ababb712300 x1875683630495744/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788791761 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791761.699377:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791751/real 1788791751] req@ffff9ababb6d2d80 x1875683630495616/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788791761 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791761.699389:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ababb6d2d80 x1875683630495616/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788791761 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788791761.699407:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ab9819fa800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788791761.701374:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) aa113159-ee5b-4f24-93ba-c8c094c83d87->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788791761.701384:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788791761.701388:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ab9819fa800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788791761.701396:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 527 00000100:00080000:2.0:1788791761.701402:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.129@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788791761.701409:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9ab9819fa800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788791761.701448:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb711f80 x1875683630496128/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788791761.701561:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630496256:0@lo:400:kworker.0 00000400:00000100:3.0:1788791761.701616:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683630496256 offset 0 length 224: 4 00000100:00080000:0.0:1788791761.705669:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788791761.705681:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa113159-ee5b-4f24-93ba-c8c094c83d87:3311:1875683630495744:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1788791761.705694:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9abaa9b3f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788791761.705710:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875683630495616:0@lo:39:umount.0 00000100:00080000:3.0:1788791761.705740:0:17649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788791761.705744:0:17649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788791761.705749:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa113159-ee5b-4f24-93ba-c8c094c83d87:3311:1875683630496128:0@lo:250:kworker.0 00000100:00100000:3.0:1788791761.705750:0:17649:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000400:00000100:0.0:1788791761.705820:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875683630496128 offset 0 length 520: 4 00010000:00010000:3.0:1788791761.707091:0:17649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791761.707153:0:17649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791761.707160:0:17649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791761.707166:0:17649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791761.707250:0:17649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791761.707258:0:17649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791761.707263:0:17649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791761.707267:0:17649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791761.707271:0:17649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791761.707291:0:16035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788791761.707296:0:16035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791761.707306:0:16035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fee00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791761.707309:0:16035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791761.707314:0:16035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791761.707319:0:16035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791761.707324:0:16035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788791761.707327:0:16035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1788791761.707450:0:17649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788791761.707454:0:17649:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788791761.707473:0:17649:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788791761.707476:0:17649:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788791761.707480:0:17649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791761.707484:0:17649:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788791761.707487:0:17649:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9ababc14cd28) has no exports 00000020:00080000:3.0:1788791761.707513:0:17649:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9ababc14cd28) has no exports 10000000:01000000:0.0:1788791761.707633:0:16035:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788791761.707646:0:16035:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ab9819fa800 00010000:00010000:0.0:1788791761.707649:0:16035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791761.707654:0:16035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791761.707664:0:16035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791761.707666:0:16035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791761.707669:0:16035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ba00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791761.707671:0:16035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791761.707675:0:16035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791761.707684:0:16035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791761.707687:0:16035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788791761.707689:0:16035:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788791761.707689:0:16035:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788791761.707694:0:16035:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ab9819fa800 00010000:00010000:0.0:1788791761.707696:0:16035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791761.707699:0:16035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791761.707703:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791761.707705:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791761.707706:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791761.707754:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788791761.710077:0:17649:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9aba99249540 - data ffff9abaacb765e8/ffff9ab981eba800 00000020:01000000:3.0:1788791761.710437:0:17649:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9aba85619e40 - data ffff9aba9e90ad80/ffff9abab7485000 00100000:10000000:3.0:1788791761.721053:0:17649:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788791761.752454:0:17649:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323e0e 00000020:00000080:3.0:1788791761.752466:0:17649:0:(genops.c:885:class_export_put()) final put ffff9ab98126b800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788791761.752489:0:17649:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9aba993ab000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788791761.752493:0:17649:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9aba993ab000 2 00000020:01000004:3.0:1788791761.752496:0:17649:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9aba993ab000 from lustre-OST0000 00000020:00000080:3.0:1788791761.752522:0:17649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791761.752531:0:17649:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788791761.752534:0:17649:0:(genops.c:885:class_export_put()) final put ffff9ab981268000/lustre-OST0000_UUID 00000020:00000080:3.0:1788791761.752536:0:17649:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab981268000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788791761.752546:0:17649:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:2.0:1788791761.752787:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab98126b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1788791761.752847:0:17649:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788791761.752852:0:17649:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788791761.752856:0:17649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791761.752862:0:17649:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788791761.752868:0:17649:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9abaa9b3b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788791761.752874:0:17649:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9abab748b370) has exports, disconnecting them 00000020:00080000:3.0:1788791761.752879:0:17649:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9abaa9b3b000), last request at 1788791679 00000020:00000080:3.0:1788791761.752882:0:17649:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323e38 00000020:00080000:3.0:1788791761.752894:0:17649:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9abaa9b3b000): rc 0 00000020:00000080:3.0:1788791761.752898:0:17649:0:(genops.c:885:class_export_put()) final put ffff9abaa9b3b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788791761.753259:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa9b3b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788791761.757308:0:17649:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788791761.757452:0:17649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788791761.757457:0:17649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788791761.757464:0:17649:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788791761.757661:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abaa9b3f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788791761.757767:0:17649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791761.757777:0:17649:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788791761.757782:0:17649:0:(genops.c:885:class_export_put()) final put ffff9abaa9b3b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788791761.757786:0:17649:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa9b3b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788791761.757792:0:17649:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788791761.757860:0:17649:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9aba993ab000 1 00000020:00000080:2.0:1788791761.757866:0:17649:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323ddd 00000020:00000080:2.0:1788791761.757873:0:17649:0:(genops.c:885:class_export_put()) final put ffff9aba851e3000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788791761.757958:0:17649:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788791761.757964:0:17649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791761.757969:0:17649:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788791761.757973:0:17649:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9aba88c64d28) has no exports 00000020:00000080:0.0:1788791761.758286:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba851e3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788791761.801807:0:17649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791761.801823:0:17649:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788791761.801828:0:17649:0:(genops.c:885:class_export_put()) final put ffff9aba993ae000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788791761.801833:0:17649:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba993ae000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788791761.801843:0:17649:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788791761.801966:0:17649:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9aba993a9000 00000020:02000400:0.0:1788791761.802032:0:17649:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788791762.022802:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791763.044283:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791764.072765:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788791764.518991:0:17802:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788791764.544830:0:17802:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788791764.544921:0:17802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791764.544954:0:17802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791764.544973:0:17802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791764.544981:0:17802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791764.545007:0:17802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788791764.545012:0:17802:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788791764.545037:0:17802:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788791764.545049:0:17802:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ababb710000 x1875683630495872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791767 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791764.545072:0:17802:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ababb6d3100 x1875683630496000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791772 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791764.545082:0:17802:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ababb712a00 x1875683630496256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791777 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788791764.545224:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791764.545238:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791764.545246:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851caa00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791764.545250:0:14350:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791764.545258:0:14350:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791764.545264:0:14350:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791764.545269:0:14350:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788791764.545271:0:14350:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788791764.545285:0:14350:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788791764.545300:0:14350:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ab9819fa800 00010000:00010000:1.0:1788791764.545304:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791764.545311:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791764.545321:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791764.545323:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791764.545325:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791764.545444:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630496000:0@lo:400:kworker.0 00000100:00100000:0.0:1788791764.545497:0:17802:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788791764.545505:0:17802:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788791764.547436:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630496256:0@lo:400:kworker.0 00000100:00100000:2.0:1788791764.547780:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630495872:0@lo:400:kworker.0 00000100:00080000:0.0:1788791764.549233:0:17802:0:(import.c:65:import_set_state_nolock()) ffff9ab983749000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788791764.549386:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875683630496384:0@lo:39:umount.0 00000400:00000100:1.0:1788791764.549444:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683630496384 offset 0 length 224: 4 00010000:00010000:1.0:1788791765.091561:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791766.129800:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788791766.823842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) aa113159-ee5b-4f24-93ba-c8c094c83d87->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788791766.823852:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) aa113159-ee5b-4f24-93ba-c8c094c83d87->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788791767.146841:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791768.163403:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791769.187484:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791770.211604:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791771.239616:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788791771.940330:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) aa113159-ee5b-4f24-93ba-c8c094c83d87->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788791771.940340:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) aa113159-ee5b-4f24-93ba-c8c094c83d87->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788791772.262767:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791773.283433:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791774.308072:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791774.755796:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791764/real 1788791764] req@ffff9ababbfd8000 x1875683630496384/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788791774 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791774.756183:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ababbfd8000 x1875683630496384/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788791774 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788791774.756203:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ab983749000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788791774.756239:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875683630496384:0@lo:39:umount.0 00000100:00080000:2.0:1788791774.756386:0:17802:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788791774.756391:0:17802:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788791774.756396:0:17802:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788791774.757223:0:17802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791774.757238:0:17802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791774.757258:0:17802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791774.757265:0:17802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791774.757279:0:17802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791774.757297:0:17802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791774.757304:0:17802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791774.757309:0:17802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791774.757315:0:17802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791774.757342:0:17802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788791774.757347:0:17802:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788791774.757368:0:17802:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788791774.757372:0:17802:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788791774.757377:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791774.757382:0:17802:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788791774.757386:0:17802:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9ababb06b370) has no exports 00000020:00080000:2.0:1788791774.757410:0:17802:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9ababb06b370) has no exports 00000020:01000000:2.0:1788791774.759013:0:17802:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9aba99249600 - data ffff9abab7c7d510/ffff9ab982f82800 00000020:01000000:2.0:1788791774.759200:0:17802:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9aba992499c0 - data ffff9abab7df5798/ffff9ab981eb9c00 00010000:00010000:1.0:1788791774.759443:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788791774.759452:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791774.759463:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b200 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791774.759468:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791774.759489:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791774.759496:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791774.759503:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788791774.759506:0:14349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788791774.759509:0:14349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788791774.759524:0:14349:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ab9819fa800 00010000:00010000:1.0:1788791774.759528:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791774.759535:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791774.759558:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791774.759562:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791774.759568:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca400 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791774.759571:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791774.759578:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791774.759584:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791774.759590:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788791774.759592:0:14349:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788791774.759594:0:14349:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788791774.759600:0:14349:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ab9819fa800 00010000:00010000:1.0:1788791774.759603:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791774.759609:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791774.759621:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791774.759623:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791774.759625:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791774.760990:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788791774.777000:0:17802:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788791774.826800:0:17802:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323f49 00000020:00000080:1.0:1788791774.826811:0:17802:0:(genops.c:885:class_export_put()) final put ffff9abaa70e2800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788791774.826852:0:17802:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9abab2989800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788791774.826856:0:17802:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9abab2989800 2 00000020:01000004:1.0:1788791774.826859:0:17802:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9abab2989800 from lustre-OST0001 00000020:00000080:1.0:1788791774.826951:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788791774.826964:0:17802:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788791774.826968:0:17802:0:(genops.c:885:class_export_put()) final put ffff9abaa70e0000/lustre-OST0001_UUID 00000020:00000080:1.0:1788791774.826972:0:17802:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa70e0000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788791774.826979:0:17802:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788791774.827961:0:17802:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import aa113159-ee5b-4f24-93ba-c8c094c83d87->MGS 00010000:00010000:1.0:1788791774.827983:0:17802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994fe200/0xcd6380150a323deb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a323df2 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791774.827999:0:17802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe200/0xcd6380150a323deb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a323df2 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791774.828005:0:17802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788791774.828007:0:17802:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788791774.828010:0:17802:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788791774.828036:0:17802:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ab9819fa800 00010000:00010000:1.0:1788791774.828040:0:17802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994fe200/0xcd6380150a323deb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a323df2 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791774.828057:0:17802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a323cda expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791774.828065:0:17802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a323cda expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791774.828070:0:17802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788791774.828073:0:17802:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788791774.828075:0:17802:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788791774.828456:0:17802:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ab9819fa800 00010000:00010000:1.0:1788791774.828459:0:17802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a323cda expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788791774.828482:0:17802:0:(import.c:65:import_set_state_nolock()) ffff9ab9819fa800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788791774.828485:0:17802:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788791774.828487:0:17802:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788791774.828489:0:17802:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788791774.828493:0:17802:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788791774.828503:0:17802:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ababb711f80 x1875683630496128/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788791776 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1788791774.828612:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa70e2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1788791774.829457:0:17802:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788791774.829465:0:17802:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1788791774.837298:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa113159-ee5b-4f24-93ba-c8c094c83d87:3311:1875683630496128:0@lo:250:kworker.0 10000000:01000000:1.0:1788791774.837441:0:17802:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788791774.837455:0:17802:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323cbe 00000020:00000080:1.0:1788791774.837465:0:17802:0:(genops.c:885:class_export_put()) final put ffff9aba82db3800/aa113159-ee5b-4f24-93ba-c8c094c83d87 00000020:01000000:1.0:1788791774.837484:0:17802:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.129@tcp (flags='') 00000020:00000080:1.0:1788791774.837494:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788791774.837502:0:17802:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788791774.837506:0:17802:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9abab3e38000) has no exports 10000000:01000000:2.0:1788791774.837567:0:14358:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788791774.837596:0:17802:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.129@tcp: client import never connected 00000100:00080000:1.0:1788791774.837600:0:17802:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788791774.837603:0:17802:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788791774.837606:0:17802:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788791774.837607:0:17802:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788791774.837643:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788791774.837650:0:17802:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.129@tcp (uuid aa113159-ee5b-4f24-93ba-c8c094c83d87) 00000020:01000000:1.0:1788791774.837655:0:17802:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788791774.837659:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788791774.837663:0:17802:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788791774.837667:0:17802:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ab98374d800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788791774.837672:0:17802:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff9ababc148000) has exports, disconnecting them 00000020:00080000:1.0:1788791774.837689:0:17802:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ab98374d800), last request at 1788791695 00000020:00000080:1.0:1788791774.837693:0:17802:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323f73 00000020:00080000:1.0:1788791774.837703:0:17802:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ab98374d800): rc 0 00000020:00000080:1.0:1788791774.837706:0:17802:0:(genops.c:885:class_export_put()) final put ffff9ab98374d800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788791774.838206:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba82db3800/aa113159-ee5b-4f24-93ba-c8c094c83d87 for MGC192.168.201.129@tcp 00000020:00000080:3.0:1788791774.838216:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ab9819fa800 for MGC192.168.201.129@tcp 00000020:00000080:3.0:1788791774.838221:0:36:0:(genops.c:885:class_export_put()) final put ffff9ab9819f8000/aa113159-ee5b-4f24-93ba-c8c094c83d87 00000020:00000080:3.0:1788791774.838223:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab9819f8000/aa113159-ee5b-4f24-93ba-c8c094c83d87 for MGC192.168.201.129@tcp 00000020:01000000:3.0:1788791774.838227:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.129@tcp (aa113159-ee5b-4f24-93ba-c8c094c83d87) 00000020:00000080:3.0:1788791774.838454:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab98374d800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788791774.838984:0:17802:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788791774.838989:0:17802:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788791774.838992:0:17802:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788791774.838999:0:17802:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788791774.839036:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ab983749000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788791774.839750:0:16035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788791774.839925:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788791774.840312:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788791774.840534:0:14344:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ababbfd4000:14344] 0 exiting: rc = 1 00000100:00100000:2.0:1788791774.845327:0:14345:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ab98113c000:14345] 1 exiting: rc = 0 00000100:00100000:3.0:1788791774.845583:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791774.847749:0:14348:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ababbce2200:14348] 2 exiting: rc = 0 00000100:00100000:1.0:1788791774.847880:0:14346:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ab98113cc00:14346] 0 exiting: rc = 1 00000100:00100000:0.0:1788791774.925056:0:14347:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ababbce3c00:14347] 1 exiting: rc = 0 00000100:00100000:3.0:1788791774.935353:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935367:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935373:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935379:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935385:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935390:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935395:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935401:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935406:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935411:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935416:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935422:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935427:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935432:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935437:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935442:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935447:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935453:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935458:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935464:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935471:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935476:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935482:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935506:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935511:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935516:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935522:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935528:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935533:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935537:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935542:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935560:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935566:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935571:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935576:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935582:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935587:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935592:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935596:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935602:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935607:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935611:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935616:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935622:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935626:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935632:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935636:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935641:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935646:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935650:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935655:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935660:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935665:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935670:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935676:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935681:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935687:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935691:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935704:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935710:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935715:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935720:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935738:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.935745:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788791774.936461:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791774.936471:0:17802:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788791774.936477:0:17802:0:(genops.c:885:class_export_put()) final put ffff9ababbc66000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788791774.936482:0:17802:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababbc66000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788791774.936487:0:17802:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788791774.936529:0:17802:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9abab2989800 1 00000020:00000080:3.0:1788791774.936536:0:17802:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323f2d 00000020:00000080:3.0:1788791774.936542:0:17802:0:(genops.c:885:class_export_put()) final put ffff9ab98126a800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788791774.936554:0:17802:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788791774.936565:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab98126a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788791774.936576:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791774.936581:0:17802:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788791774.936585:0:17802:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9aba88c63370) has no exports 00000020:00000080:3.0:1788791774.969887:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791774.969904:0:17802:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788791774.969910:0:17802:0:(genops.c:885:class_export_put()) final put ffff9abaa0082800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788791774.969915:0:17802:0:(genops.c:844:class_export_destroy()) destroying export ffff9abaa0082800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788791774.969926:0:17802:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788791774.970205:0:17802:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ababb5a6000 00000020:01000000:3.0:1788791774.970230:0:17802:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788791774.970235:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791774.970239:0:17802:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788791774.970244:0:17802:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9aba88c619b8) has no exports 00000020:00000080:3.0:1788791774.970276:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791774.970283:0:17802:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788791774.970285:0:17802:0:(genops.c:885:class_export_put()) final put ffff9aba851e6000/OSS_uuid 00000020:00000080:3.0:1788791774.970298:0:17802:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba851e6000/OSS_uuid for OSS 00000020:01000000:3.0:1788791774.970303:0:17802:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788791774.975713:0:14357:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788791774.975887:0:16235:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ab981271200:16235] 3 exiting: rc = 0 00000100:00100000:0.0:1788791774.976002:0:15045:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ab98202e200:15045] 1 exiting: rc = 0 00000100:00100000:0.0:1788791774.976052:0:15043:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9aba85650000:15043] 0 exiting: rc = 1 00000100:00100000:0.0:1788791774.976117:0:15046:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9aba9ee2f600:15046] 2 exiting: rc = 0 00000100:00100000:3.0:1788791774.979315:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979453:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979460:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979466:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979471:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979476:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979482:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979487:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979492:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979497:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979503:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979509:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979515:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979520:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979526:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979531:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979535:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979540:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979629:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979638:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979643:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979648:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979653:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979659:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979666:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979672:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979677:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979681:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979686:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979691:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979696:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979701:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979706:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979731:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979735:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979741:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979746:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979751:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979756:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979761:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979768:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979785:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979790:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979795:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979800:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979805:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979810:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979815:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979820:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979825:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979830:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979835:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979840:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979844:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979849:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979854:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979861:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979868:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979874:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979879:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979884:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979889:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979894:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791774.979909:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791774.983318:0:15048:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ababa91e800:15048] 1 exiting: rc = 0 00000100:00100000:0.0:1788791774.985702:0:15047:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9abac0607c00:15047] 0 exiting: rc = 1 00000100:00100000:3.0:1788791775.005306:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005318:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005323:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005447:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005470:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005474:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005479:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005484:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005490:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005496:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005501:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005507:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005511:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005517:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005522:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005527:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005532:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005537:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005541:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005646:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005651:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005656:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005661:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005667:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005673:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005679:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005685:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005691:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005699:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005704:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005710:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005714:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005719:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005724:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005729:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005733:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005737:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005742:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005747:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005760:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005767:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005805:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005813:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005818:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005824:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005829:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005834:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005839:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005844:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005849:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005855:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005861:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005870:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005875:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005880:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005885:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005890:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005895:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005899:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005904:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005909:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005914:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005919:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.005925:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.009009:0:16590:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff9aba88068c00:16590] 4 exiting: rc = 0 00000100:00100000:1.0:1788791775.009886:0:16589:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9aba88069200:16589] 3 exiting: rc = 0 00000100:00100000:1.0:1788791775.010065:0:15050:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9aba857ff200:15050] 1 exiting: rc = 0 00000100:00100000:3.0:1788791775.010902:0:15051:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9aba866f9c00:15051] 2 exiting: rc = 0 00000100:00100000:2.0:1788791775.011521:0:15049:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ababa91f400:15049] 0 exiting: rc = 1 00000100:00100000:3.0:1788791775.011868:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011876:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011891:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011918:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011925:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011931:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011936:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011941:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011947:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011966:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011971:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011976:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011982:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011987:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011993:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.011998:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012004:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012009:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012015:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012020:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012026:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012030:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012036:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012041:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012047:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012052:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012058:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012078:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012098:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012104:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012109:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012114:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012120:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012152:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012159:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012165:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012172:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012177:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012182:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012187:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012193:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012199:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012204:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012210:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012222:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012227:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012232:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012237:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012244:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012249:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012255:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012277:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012285:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012290:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012295:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012301:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012307:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012312:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012318:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012324:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012466:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012486:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012492:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791775.012499:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.023708:0:15052:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9aba866f9600:15052] 0 exiting: rc = 1 00000100:00100000:3.0:1788791775.027265:0:15053:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9aba866f9000:15053] 1 exiting: rc = 0 00000100:00100000:1.0:1788791775.027357:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027366:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027371:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027378:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027384:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027389:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027394:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027400:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027405:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027411:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027415:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027420:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027425:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027433:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027447:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027453:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027458:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027463:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027468:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027477:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027485:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027491:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027516:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027522:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027528:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027534:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027540:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027546:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027552:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027558:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027565:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027570:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027576:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027582:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027587:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027592:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027598:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027603:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027608:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027613:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027619:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027625:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027631:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027636:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027691:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027697:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027703:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027709:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027731:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027740:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027746:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027752:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027757:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027763:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027768:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027804:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027811:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027834:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027841:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027846:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027852:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027858:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027863:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.027869:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.028589:0:15055:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9aba98ed6c00:15055] 1 exiting: rc = 0 00000100:00100000:3.0:1788791775.029660:0:15054:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9aba98ed7000:15054] 0 exiting: rc = 1 00000100:00100000:1.0:1788791775.029821:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029843:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029851:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029858:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029890:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029899:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029905:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029911:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029918:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029924:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029930:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029938:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029944:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029950:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029957:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029963:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029985:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029993:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.029998:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030004:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030010:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030016:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030021:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030027:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030034:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030039:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030047:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030067:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030090:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030243:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030317:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030324:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030330:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030336:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030341:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030420:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030429:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030436:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030523:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030529:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030553:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030561:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030567:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030573:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030580:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030585:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030592:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030597:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030603:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030609:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030615:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030622:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030643:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030650:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030656:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030662:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030669:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030678:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030685:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030692:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030697:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030703:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030716:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791775.030722:0:17802:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788791775.050024:0:17802:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788791792.762107:0:18417:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788791801.029262:0:18877:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788791801.029270:0:18877:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788791801.029653:0:18877:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9abab29de000 00000020:01000004:0.0:1788791801.029669:0:18877:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788791801.029677:0:18877:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788791801.029691:0:18877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ababb0699b8) 00000020:00000080:0.0:1788791801.029704:0:18877:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788791801.048072:0:18877:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788791801.050715:0:18877:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:1.0:1788791801.051249:0:18877:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788791801.051335:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 397: rc = 0 00100000:10000000:1.0:1788791801.051588:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 397: rc = 0 00100000:10000000:1.0:1788791801.051682:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 397: rc = 0 00100000:10000000:1.0:1788791801.051823:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 397: rc = 0 00100000:10000000:1.0:1788791801.051924:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 397: rc = 0 00100000:10000000:1.0:1788791801.052022:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 397: rc = 0 00100000:10000000:1.0:1788791801.052306:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 399: rc = 0 00100000:10000000:1.0:1788791801.053968:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 97: rc = 0 00100000:10000000:1.0:1788791801.054073:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 97: rc = 0 00100000:10000000:1.0:1788791801.057865:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 102: rc = 0 00100000:10000000:1.0:1788791801.058114:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 102: rc = 0 00100000:10000000:1.0:1788791801.058834:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 102: rc = 0 00100000:10000000:1.0:1788791801.059076:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 102: rc = 0 00100000:10000000:1.0:1788791801.059363:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 102: rc = 0 00100000:10000000:1.0:1788791801.059627:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 102: rc = 0 00100000:10000000:1.0:1788791801.059877:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 102: rc = 0 00100000:10000000:1.0:1788791801.060122:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 102: rc = 0 00100000:10000000:1.0:1788791801.061450:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 102: rc = 0 00100000:10000000:1.0:1788791801.061740:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 102: rc = 0 00100000:10000000:1.0:1788791801.061996:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 102: rc = 0 00100000:10000000:1.0:1788791801.062283:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 102: rc = 0 00100000:10000000:1.0:1788791801.062707:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 127: rc = 0 00100000:10000000:1.0:1788791801.062964:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 127: rc = 0 00100000:10000000:1.0:1788791801.063256:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 127: rc = 0 00100000:10000000:1.0:1788791801.063514:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 127: rc = 0 00100000:10000000:1.0:1788791801.063760:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 127: rc = 0 00100000:10000000:1.0:1788791801.064023:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 127: rc = 0 00100000:10000000:1.0:1788791801.064295:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 127: rc = 0 00100000:10000000:2.0:1788791801.078746:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 127: rc = 0 00100000:10000000:2.0:1788791801.079025:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 127: rc = 0 00100000:10000000:2.0:1788791801.079304:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 127: rc = 0 00100000:10000000:2.0:1788791801.082806:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 127: rc = 0 00100000:10000000:2.0:1788791801.083181:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 127: rc = 0 00100000:10000000:2.0:1788791801.083457:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 127: rc = 0 00100000:10000000:2.0:1788791801.090357:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 127: rc = 0 00100000:10000000:2.0:1788791801.091992:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 127: rc = 0 00100000:10000000:2.0:1788791801.099718:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 127: rc = 0 00100000:10000000:2.0:1788791801.100017:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 127: rc = 0 00100000:10000000:2.0:1788791801.100331:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 127: rc = 0 00100000:10000000:2.0:1788791801.100605:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 127: rc = 0 00100000:10000000:2.0:1788791801.100847:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 127: rc = 0 00100000:10000000:2.0:1788791801.101157:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 127: rc = 0 00100000:10000000:2.0:1788791801.103975:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 127: rc = 0 00100000:10000000:2.0:1788791801.104334:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 127: rc = 0 00100000:10000000:2.0:1788791801.106759:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 127: rc = 0 00100000:10000000:2.0:1788791801.107197:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 127: rc = 0 00100000:10000000:2.0:1788791801.107469:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 127: rc = 0 00100000:10000000:2.0:1788791801.107725:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 127: rc = 0 00100000:10000000:3.0:1788791801.108813:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 127: rc = 0 00100000:10000000:3.0:1788791801.109077:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 127: rc = 0 00100000:10000000:3.0:1788791801.109374:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 127: rc = 0 00100000:10000000:3.0:1788791801.109632:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 127: rc = 0 00100000:10000000:3.0:1788791801.109860:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 127: rc = 0 00100000:10000000:3.0:1788791801.110192:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 116: rc = 0 00100000:10000000:3.0:1788791801.110664:0:18877:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788791801.110827:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 98: rc = 0 00100000:10000000:3.0:1788791801.111012:0:18877:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788791801.111088:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 98: rc = 0 00100000:10000000:3.0:1788791801.111377:0:18877:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788791801.111448:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 98: rc = 0 00100000:10000000:3.0:1788791801.111774:0:18877:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788791801.111836:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 606: rc = 0 00100000:10000000:3.0:1788791801.112016:0:18877:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788791801.112073:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 606: rc = 0 00100000:10000000:3.0:1788791801.112306:0:18877:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788791801.112605:0:18877:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 606: rc = 0 00000020:00000080:3.0:1788791801.112877:0:18877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788791801.112886:0:18877:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788791801.112898:0:18877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a324394 00000020:01000004:3.0:1788791801.112907:0:18877:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788791801.112911:0:18877:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788791801.112916:0:18877:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9abab29de000 from MGS 00000020:01000004:3.0:1788791801.112920:0:18877:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788791801.112930:0:18877:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9abab74899b8) 00000020:00000080:3.0:1788791801.112940:0:18877:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788791801.112994:0:18877:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9abab29de000 from MGS, refs=2 00080000:01000000:3.0:1788791801.112999:0:18877:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788791801.113004:0:18877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a3243a2 00000100:00100000:3.0:1788791801.113097:0:18877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788791801.113256:0:18877:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788791801.113262:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788791801.113829:0:18877:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788791801.113837:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788791801.114644:0:18877:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791801.115363:0:18877:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788791801.115370:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788791801.116056:0:18877:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788791801.116063:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788791801.116678:0:18877:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788791801.116685:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788791801.117330:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791801.117334:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791801.117336:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791801.117665:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791801.117669:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791801.117670:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791801.118248:0:18877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788791801.124635:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788791801.128108:0:18877:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788791801.128230:0:18877:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788791801.128233:0:18877:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788791801.134740:0:18887:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788791801.134954:0:18877:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788791801.135069:0:18877:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788791801.135840:0:18877:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788791801.136183:0:18877:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788791801.136367:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788791801.136374:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788791801.141803:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788791801.141817:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788791801.142277:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788791801.142285:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788791801.142983:0:18877:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788791801.143005:0:18877:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.129@tcp' 00000020:01000004:1.0:1788791801.143007:0:18877:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788791801.143038:0:18877:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.129@tcp (typ=mgc) 00000020:00000080:1.0:1788791801.143050:0:18877:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.129@tcp (ffff9aba88c619b8) 00000020:00000080:1.0:1788791801.143065:0:18877:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788791801.143203:0:18877:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9abab306a000@MGC192.168.201.129@tcp: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1788791801.143363:0:18877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.129@tcp-0 is initialized 00000040:01000000:1.0:1788791801.143369:0:18877:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788791801.143828:0:18891:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788791801.143966:0:18892:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788791801.144036:0:18877:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.129@tcp (uuid bac980b1-b5e1-46bc-b749-0bf83764d3cb) 00000020:00000080:3.0:1788791801.144052:0:18877:0:(genops.c:1385:class_connect()) connect: client bac980b1-b5e1-46bc-b749-0bf83764d3cb, cookie 0xcd6380150a3243b0 00000100:00080000:3.0:1788791801.144063:0:18877:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788791801.144068:0:18877:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9abab306a000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788791801.144096:0:18877:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb6d3480 x1875683630496512/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788791801.144172:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3311:1875683630496512:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788791801.144232:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791801.144339:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630496512 00000100:00100000:1.0:1788791801.144347:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630496512 00000100:00100000:1.0:1788791801.144382:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788791801.144389:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3311:x1875683630496512:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788791801.144408:0:18889:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from bac980b1-b5e1-46bc-b749-0bf83764d3cb@0@lo t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:1.0:1788791801.144429:0:18889:0:(genops.c:1385:class_connect()) connect: client bac980b1-b5e1-46bc-b749-0bf83764d3cb, cookie 0xcd6380150a3243b7 00000100:00080000:1.0:1788791801.144550:0:18889:0:(import.c:65:import_set_state_nolock()) ffff9abab306c000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788791801.144622:0:18877:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bac980b1-b5e1-46bc-b749-0bf83764d3cb->MGS 00000020:01000004:3.0:1788791801.144639:0:18877:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788791801.144644:0:18877:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788791801.144655:0:18877:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9abab7488000) 00000020:00000080:3.0:1788791801.144664:0:18877:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788791801.148684:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+5:3311:x1875683630496512:12345-0@lo:250:mount.lustre.0 Request processed in 4284us (4441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791801.148701:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788791801.151665:0:3311:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788791801.151684:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.129@tcp: connect to target with instance 0 00000100:00080000:0.0:1788791801.151694:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788791801.151699:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788791801.151714:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9abab306a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788791801.151718:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788791801.153612:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788791801.153631:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3311:1875683630496512:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788791801.161999:0:18877:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791801.162255:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788791801.162263:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788791801.166492:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788791801.166579:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788791801.167695:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788791801.167703:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788791801.171662:0:18877:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788791801.171847:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788791801.171853:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788791801.173098:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788791801.173107:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788791801.212642:0:18877:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788791801.212847:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788791801.212853:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788791801.223782:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788791801.223797:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788791801.224613:0:18877:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791801.224916:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788791801.224921:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788791801.225461:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788791801.225468:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788791801.225982:0:18877:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791801.226120:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788791801.226293:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788791801.226776:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788791801.226782:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788791801.227402:0:18877:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791801.227652:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788791801.227658:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788791801.228096:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788791801.228103:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788791801.240925:0:18877:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791801.241113:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788791801.241120:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788791801.242423:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788791801.242435:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788791801.243405:0:18877:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788791801.243589:0:18877:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788791801.244388:0:18877:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788791801.244411:0:18877:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788791801.244419:0:18877:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788791801.244635:0:18877:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788791801.244668:0:18877:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788791801.244673:0:18877:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788791801.244675:0:18877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788791801.244677:0:18877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791801.244678:0:18877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791801.244679:0:18877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791801.244681:0:18877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791801.244682:0:18877:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788791801.244684:0:18877:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788791801.244686:0:18877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791801.244687:0:18877:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788791801.244690:0:18877:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788791801.244693:0:18877:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788791801.244694:0:18877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788791801.244695:0:18877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791801.244696:0:18877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791801.244697:0:18877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791801.244698:0:18877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791801.244699:0:18877:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788791801.244700:0:18877:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788791801.244701:0:18877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791801.244702:0:18877:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788791801.244739:0:18877:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788791801.244758:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630496640:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788791801.244826:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791801.244907:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba82bbc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791801.244972:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630496640 00000100:00100000:3.0:1788791801.244981:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630496640 00000100:00100000:3.0:1788791801.245059:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791801.245068:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+5:18877:x1875683630496640:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788791801.245110:0:18890:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788791801.245113:0:18890:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788791801.245116:0:18890:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788791801.245532:0:18911:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788791801.245946:0:18890:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:2.0:1788791801.246891:0:18912:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788791801.246898:0:18912:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788791801.246900:0:18912:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788791801.246935:0:18912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788791801.247219:0:18890:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788791801.247229:0:18890:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788791801.254166:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+5:18877:x1875683630496640:12345-0@lo:253:mount.lustre.0 Request processed in 9053us (9293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791801.254181:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788791801.254412:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630496640:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788791801.254440:0:18877:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788791801.254443:0:18877:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788791801.254444:0:18877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788791801.254446:0:18877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791801.254447:0:18877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791801.254448:0:18877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791801.254449:0:18877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791801.254450:0:18877:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788791801.254452:0:18877:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788791801.254453:0:18877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791801.254454:0:18877:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788791801.254482:0:18877:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9abab29de000 from lustre-MDT0000 10000000:01000000:0.0:1788791801.254579:0:18877:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788791801.254582:0:18877:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788791801.254586:0:18877:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9aba88c619b8 10000000:01000000:0.0:1788791801.254591:0:18877:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788791801.254599:0:18877:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9aba88c619b8 from 1 10000000:01000000:0.0:1788791801.254601:0:18877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788791801.254702:0:18877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cae00/0xcd6380150a3243c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.254713:0:18877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba851cae00/0xcd6380150a3243c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.254722:0:18877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba851cae00/0xcd6380150a3243c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791801.254740:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630496768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788791801.254778:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791801.254854:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba82bac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791801.254901:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630496768 00000100:00100000:1.0:1788791801.254908:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630496768 00000100:00100000:1.0:1788791801.254990:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788791801.255001:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+5:18877:x1875683630496768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788791801.255013:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791801.255043:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb92c600/0xcd6380150a3243cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a3243c5 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791801.255064:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb92c600/0xcd6380150a3243cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a3243c5 expref: 6 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791801.255073:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb92c600/0xcd6380150a3243cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3243c5 expref: 6 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791801.255081:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92c600, rc 0) 00000100:00100000:1.0:1788791801.255122:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+6:18877:x1875683630496768:12345-0@lo:101:mount.lustre.0 Request processed in 124us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791801.255151:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788791801.255280:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630496768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791801.255293:0:18877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba851cae00/0xcd6380150a3243c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243cc expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.255332:0:18877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba851cae00/0xcd6380150a3243c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a3243cc expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791801.255379:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630496896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791801.255405:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791801.255703:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba82bac9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791801.255815:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630496896 00000100:00100000:3.0:1788791801.255820:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630496896 00000100:00100000:3.0:1788791801.255846:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788791801.255853:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+6:18877:x1875683630496896:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791801.256167:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+6:18877:x1875683630496896:12345-0@lo:501:mount.lustre.0 Request processed in 301us (747us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788791801.256182:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791801.256287:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630496896:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788791801.256328:0:18877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788791801.256352:0:18877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cae00/0xcd6380150a3243c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243cc expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.256362:0:18877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba851cae00/0xcd6380150a3243c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243cc expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791801.256371:0:18877:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9abab29de000 10000000:01000000:0.0:1788791801.256375:0:18877:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788791801.256379:0:18877:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9abab29de000 10000000:01000000:0.0:1788791801.256382:0:18877:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788791801.256385:0:18877:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9abab29de000 from 1 10000000:01000000:0.0:1788791801.256387:0:18877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788791801.256406:0:18877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cac00/0xcd6380150a3243d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.256414:0:18877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba851cac00/0xcd6380150a3243d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.256422:0:18877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba851cac00/0xcd6380150a3243d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791801.256444:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630497024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788791801.256474:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791801.256617:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630497024 00000100:00100000:0.0:1788791801.256687:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630497024 00000100:00100000:0.0:1788791801.256712:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788791801.256718:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+6:18877:x1875683630497024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791801.256727:0:18889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791801.256739:0:18889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba851ca200/0xcd6380150a3243da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a3243d3 expref: -99 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.256757:0:18889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba851ca200/0xcd6380150a3243da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a3243d3 expref: 7 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.256765:0:18889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba851ca200/0xcd6380150a3243da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3243d3 expref: 7 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.256773:0:18889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba851ca200, rc 0) 00000100:00100000:0.0:1788791801.256799:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+7:18877:x1875683630497024:12345-0@lo:101:mount.lustre.0 Request processed in 80us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791801.256805:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788791801.256836:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba82bac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791801.256850:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630497024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791801.256861:0:18877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba851cac00/0xcd6380150a3243d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243da expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.256868:0:18877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba851cac00/0xcd6380150a3243d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a3243da expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791801.256887:0:18877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788791801.256902:0:18877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cac00/0xcd6380150a3243d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243da expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.256909:0:18877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba851cac00/0xcd6380150a3243d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243da expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791801.256914:0:18877:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788791801.256918:0:18877:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788791801.256922:0:18877:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9abab29de000 10000000:01000000:0.0:1788791801.256924:0:18877:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788791801.256927:0:18877:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788791801.256929:0:18877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788791801.256942:0:18877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cbe00/0xcd6380150a3243e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.256949:0:18877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba851cbe00/0xcd6380150a3243e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.256957:0:18877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba851cbe00/0xcd6380150a3243e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791801.256969:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630497152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788791801.256996:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791801.257016:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630497152 00000100:00100000:0.0:1788791801.257020:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630497152 00000100:00100000:0.0:1788791801.257037:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788791801.257043:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+7:18877:x1875683630497152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791801.257056:0:18889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791801.257064:0:18889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba851ca800/0xcd6380150a3243e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a3243e1 expref: -99 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.257079:0:18889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba851ca800/0xcd6380150a3243e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a3243e1 expref: 8 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.257087:0:18889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba851ca800/0xcd6380150a3243e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3243e1 expref: 8 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.257093:0:18889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba851ca800, rc 0) 00000100:00100000:0.0:1788791801.257115:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+8:18877:x1875683630497152:12345-0@lo:101:mount.lustre.0 Request processed in 72us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791801.257120:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788791801.257170:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba82bac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791801.257181:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630497152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791801.257191:0:18877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba851cbe00/0xcd6380150a3243e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243e8 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.257199:0:18877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba851cbe00/0xcd6380150a3243e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a3243e8 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791801.257237:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630497280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791801.257262:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791801.257282:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630497280 00000100:00100000:0.0:1788791801.257286:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630497280 00000100:00100000:0.0:1788791801.257302:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788791801.257309:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+8:18877:x1875683630497280:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791801.257994:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788791801.258257:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+9:18877:x1875683630497280:12345-0@lo:501:mount.lustre.0 Request processed in 947us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791801.258265:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788791801.258357:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630497280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791801.258398:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630497408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788791801.258440:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791801.258471:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9924ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788791801.258546:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630497408 00000100:00100000:1.0:1788791801.258551:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630497408 00000100:00100000:1.0:1788791801.258580:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788791801.258587:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+9:18877:x1875683630497408:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788791801.259072:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+9:18877:x1875683630497408:12345-0@lo:503:mount.lustre.0 Request processed in 483us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791801.259081:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788791801.259203:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630497408:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788791801.259688:0:18913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18913:1875683630497536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791801.259734:0:18913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791801.259766:0:18913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abac05673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791801.259816:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630497536 00000100:00100000:3.0:1788791801.259821:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630497536 00000100:00100000:3.0:1788791801.259854:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788791801.259862:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+9:18913:x1875683630497536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791801.260089:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+9:18913:x1875683630497536:12345-0@lo:502:llog_process_th.0 Request processed in 227us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791801.260095:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788791801.260155:0:18913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18913:1875683630497536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788791801.260177:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791801.260187:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791801.260189:0:18913:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788791801.260195:0:18913:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788791801.260197:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788791801.260211:0:18913:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9abab748cd28) 00000020:00000080:3.0:1788791801.260227:0:18913:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788791801.260231:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788791801.260285:0:18913:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788791801.260290:0:18913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a3243f6 00000020:00000080:3.0:1788791801.260517:0:18913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788791801.260527:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791801.260530:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791801.260532:0:18913:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788791801.260535:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791801.260538:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791801.260539:0:18913:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788791801.260542:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788791801.260549:0:18913:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9abab748b370) 00000020:00000080:3.0:1788791801.260558:0:18913:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788791801.260561:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788791801.260564:0:18913:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788791801.260566:0:18913:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788791801.260571:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788791801.260617:0:18913:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9abab29de000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788791801.260635:0:18913:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9aba99383370) 00000020:00000080:3.0:1788791801.260644:0:18913:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788791801.260726:0:18913:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788791801.260731:0:18913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a32440b 00000020:00000080:3.0:1788791801.260812:0:18913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788791801.260817:0:18913:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788791801.260820:0:18913:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcd6380150a324412 00080000:01000000:3.0:1788791801.260826:0:18913:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788791801.260829:0:18913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a324419 00010000:00010000:3.0:1788791801.324773:0:18913:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788791801.325608:0:18913:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1788791801.325896:0:18913:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788791801.326693:0:18913:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9aba993819b8) 00000020:00000080:3.0:1788791801.326716:0:18913:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788791801.326797:0:18913:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788791801.326804:0:18913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a324427 00000020:00000080:2.0:1788791801.327439:0:18913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788791801.337121:0:18913:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcd6380150a32442e 00000020:00000080:0.0:1788791801.351172:0:18913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788791801.351187:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791801.351197:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791801.351199:0:18913:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788791801.351203:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788791801.351205:0:18913:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788791801.351207:0:18913:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788791801.351209:0:18913:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788791801.351210:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788791801.351213:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791801.351214:0:18913:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788791801.351217:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791801.351222:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791801.351223:0:18913:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788791801.351228:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788791801.351275:0:18913:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788791801.351295:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791801.351299:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791801.351300:0:18913:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788791801.351303:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788791801.351307:0:18913:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788791801.351321:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791801.351322:0:18913:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788791801.351325:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788791801.351331:0:18913:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:0.0:1788791801.351369:0:18913:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788791801.351372:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788791801.351402:0:18913:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ababb068000) 00000020:00000080:0.0:1788791801.351420:0:18913:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788791801.351426:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788791801.351492:0:18913:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788791801.351497:0:18913:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788791801.351515:0:18913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a32443c 00010000:00080000:0.0:1788791801.351547:0:18913:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9aba98e49000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:0.0:1788791801.351947:0:18913:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788791801.352433:0:18913:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788791801.352472:0:18913:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788791801.361272:0:18913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788791801.361384:0:18913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788791801.361487:0:18913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788791801.367357:0:18917:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788791801.367367:0:18917:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788791801.368791:0:18913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788791801.368806:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788791801.368846:0:18913:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788791801.368870:0:18913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a324443 00000100:00080000:1.0:1788791801.368880:0:18913:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788791801.368886:0:18913:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9aba98e49000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788791801.368927:0:18913:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9abab3083100 x1875683630497664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788791801.368960:0:18913:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788791801.369018:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788791801.369023:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791801.369025:0:18913:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788791801.369028:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788791801.369031:0:18913:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788791801.369032:0:18913:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788791801.369034:0:18913:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788791801.369036:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788791801.369039:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791801.369040:0:18913:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788791801.369043:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788791801.369047:0:18913:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788791801.369050:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791801.369052:0:18913:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788791801.369061:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788791801.369065:0:18913:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:1.0:1788791801.369094:0:18913:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788791801.369097:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788791801.369109:0:18913:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9aba88c60000) 00000020:00000080:1.0:1788791801.369120:0:18913:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788791801.369153:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788791801.369213:0:18913:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788791801.369220:0:18913:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788791801.369226:0:18913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a324451 00010000:00080000:1.0:1788791801.369259:0:18913:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ababb9ae000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1788791801.369482:0:18913:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788791801.369662:0:18913:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788791801.369682:0:18913:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788791801.370343:0:18913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788791801.370412:0:18913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788791801.370506:0:18913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:2.0:1788791801.370851:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630497664:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788791801.370916:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683630497664 offset 0 length 520: 4 00000040:00080000:0.0:1788791801.380712:0:18919:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788791801.380722:0:18919:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788791801.399910:0:18913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788791801.399927:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788791801.399967:0:18913:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788791801.399988:0:18913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a324458 00000100:00080000:1.0:1788791801.399998:0:18913:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788791801.400004:0:18913:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ababb9ae000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788791801.400041:0:18913:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9abab3081500 x1875683630497792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788791801.400117:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630497792:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788791801.400206:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683630497792 offset 0 length 520: 4 00000100:00080000:1.0:1788791801.400288:0:18913:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788791801.400348:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788791801.400352:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791801.400353:0:18913:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788791801.400357:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788791801.400369:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791801.400370:0:18913:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788791801.400374:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788791801.400376:0:18913:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788791801.400378:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788791801.400380:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791801.400382:0:18913:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788791801.400384:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788791801.400387:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791801.400388:0:18913:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788791801.400391:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788791801.400422:0:18913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18913:1875683630497920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791801.400473:0:18913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791801.400496:0:18913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba89179f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791801.400955:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630497920 00000100:00100000:3.0:1788791801.400963:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630497920 00000100:00100000:3.0:1788791801.401009:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791801.401024:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+9:18913:x1875683630497920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791801.401292:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+9:18913:x1875683630497920:12345-0@lo:502:llog_process_th.0 Request processed in 268us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791801.401300:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788791801.401416:0:18913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18913:1875683630497920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788791801.401442:0:18913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791801.401446:0:18913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791801.401448:0:18913:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788791801.401454:0:18913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788791801.401704:0:18877:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788791801.401723:0:18877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788791801.401746:0:18877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cbe00/0xcd6380150a3243e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243e8 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791801.401757:0:18877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba851cbe00/0xcd6380150a3243e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243e8 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791801.401765:0:18877:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9abab29de000 from 1 10000000:01000000:3.0:1788791801.401768:0:18877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788791801.401800:0:18877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791801.401807:0:18877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791801.401817:0:18877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791801.401833:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630498048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788791801.401866:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791801.401892:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9924f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791801.401909:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630498048 00000100:00100000:3.0:1788791801.401914:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630498048 00000100:00100000:3.0:1788791801.401938:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788791801.401953:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+9:18877:x1875683630498048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791801.401962:0:18890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791801.401975:0:18890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16ce00/0xcd6380150a324466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a32445f expref: -99 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791801.401997:0:18890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16ce00/0xcd6380150a324466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a32445f expref: 10 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791801.402008:0:18890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16ce00/0xcd6380150a324466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a32445f expref: 10 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791801.402017:0:18890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16ce00, rc 0) 00000100:00100000:3.0:1788791801.402048:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+10:18877:x1875683630498048:12345-0@lo:101:mount.lustre.0 Request processed in 96us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791801.402054:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788791801.402087:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630498048:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791801.402100:0:18877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324466 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791801.402109:0:18877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a324466 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791801.403714:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630498176:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788791801.403775:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791801.403855:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9924f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791801.403908:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630498176 00000100:00100000:0.0:1788791801.403915:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630498176 00000100:00100000:0.0:1788791801.404000:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788791801.404011:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+10:18877:x1875683630498176:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788791801.404029:0:18890:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788791801.404038:0:18890:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788791801.404116:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+10:18877:x1875683630498176:12345-0@lo:256:mount.lustre.0 Request processed in 107us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791801.404154:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788791801.404230:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630498176:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788791801.404788:0:18877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788791801.404856:0:18877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324466 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791801.404866:0:18877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324466 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791801.404874:0:18877:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9abab29de000 from 1 10000000:01000000:3.0:1788791801.404876:0:18877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788791801.404904:0:18877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791801.404912:0:18877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791801.404921:0:18877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791801.404936:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630498304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788791801.404970:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791801.405579:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9924f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791801.405740:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630498304 00000100:00100000:1.0:1788791801.405748:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630498304 00000100:00100000:2.0:1788791801.405906:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788791801.405926:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+10:18877:x1875683630498304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788791801.405939:0:18889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791801.405956:0:18889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994fea00/0xcd6380150a324474 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a32446d expref: -99 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791801.405992:0:18889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994fea00/0xcd6380150a324474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a32446d expref: 11 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791801.406003:0:18889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994fea00/0xcd6380150a324474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a32446d expref: 11 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791801.406011:0:18889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fea00, rc 0) 00000100:00100000:2.0:1788791801.406103:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:18877:x1875683630498304:12345-0@lo:101:mount.lustre.0 Request processed in 179us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791801.406110:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788791801.406259:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630498304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791801.406274:0:18877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324474 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791801.406282:0:18877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a324474 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791801.406363:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630498432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791801.406394:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791801.406458:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9924f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791801.406897:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630498432 00000100:00100000:2.0:1788791801.406904:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630498432 00000100:00100000:2.0:1788791801.406985:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788791801.406993:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:18877:x1875683630498432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791801.407409:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:18877:x1875683630498432:12345-0@lo:501:mount.lustre.0 Request processed in 416us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791801.407417:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788791801.407497:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630498432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788791801.407546:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3082d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630498560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788791801.407589:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791801.407902:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba89179d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788791801.407992:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630498560 00000100:00100000:3.0:1788791801.407998:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630498560 00000100:00100000:3.0:1788791801.408024:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788791801.408032:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:18877:x1875683630498560:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788791801.408328:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:18877:x1875683630498560:12345-0@lo:503:mount.lustre.0 Request processed in 296us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791801.408335:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788791801.408604:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3082d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630498560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788791801.409020:0:18921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18921:1875683630498688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791801.409061:0:18921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791801.409154:0:18921:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9924f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791801.409277:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630498688 00000100:00100000:2.0:1788791801.409283:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630498688 00000100:00100000:2.0:1788791801.409352:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788791801.409361:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:18921:x1875683630498688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791801.409771:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:18921:x1875683630498688:12345-0@lo:502:llog_process_th.0 Request processed in 411us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791801.409784:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788791801.409868:0:18921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18921:1875683630498688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788791801.409898:0:18921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791801.409907:0:18921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791801.409910:0:18921:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788791801.409919:0:18921:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9abab29de000 00000020:00000080:0.0:1788791801.409922:0:18921:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788791801.409930:0:18921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791801.409932:0:18921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791801.409934:0:18921:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788791801.409936:0:18921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791801.409937:0:18921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791801.409938:0:18921:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788791801.409941:0:18921:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9abab29de000 00000020:00000080:0.0:1788791801.409943:0:18921:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788791801.410048:0:18921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791801.410052:0:18921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791801.410054:0:18921:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788791801.410057:0:18921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791801.410059:0:18921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791801.410060:0:18921:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788791801.410064:0:18921:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9abab29de000 00000020:00000080:0.0:1788791801.410066:0:18921:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788791801.414012:0:18921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18921:1875683630498816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791801.414098:0:18921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791801.414169:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630498816 00000100:00100000:0.0:1788791801.414177:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630498816 00000100:00100000:0.0:1788791801.421828:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788791801.421849:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:18921:x1875683630498816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791801.422168:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:18921:x1875683630498816:12345-0@lo:502:llog_process_th.0 Request processed in 325us (8068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791801.422177:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788791801.422264:0:18921:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788791801.422289:0:18921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18921:1875683630498816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788791801.422336:0:18921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791801.422344:0:18921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791801.422347:0:18921:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788791801.422353:0:18921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788791801.423690:0:18877:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788791801.423720:0:18877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788791801.423744:0:18877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324474 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791801.423757:0:18877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324474 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791801.423802:0:18877:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788791801.423812:0:18877:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9abab29de000 10000000:01000000:1.0:1788791801.423814:0:18877:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9abab29de000 10000000:01000000:1.0:1788791801.423818:0:18877:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788791801.423823:0:18877:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9abab29de000 from 1 10000000:01000000:1.0:1788791801.423825:0:18877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788791801.423861:0:18877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb92d200/0xcd6380150a32447b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791801.423869:0:18877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb92d200/0xcd6380150a32447b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791801.423878:0:18877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb92d200/0xcd6380150a32447b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791801.423899:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3082d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630498944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788791801.423951:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791801.432800:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791801.432889:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630498944 00000100:00100000:2.0:1788791801.432901:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630498944 00000100:00100000:2.0:1788791801.433696:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788791801.433710:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:18877:x1875683630498944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788791801.433727:0:18889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791801.433746:0:18889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ff800/0xcd6380150a324482 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a32447b expref: -99 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791801.433774:0:18889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff800/0xcd6380150a324482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a32447b expref: 12 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791801.433785:0:18889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ff800/0xcd6380150a324482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a32447b expref: 12 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791801.433794:0:18889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff800, rc 0) 00000100:00100000:2.0:1788791801.433865:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18877:x1875683630498944:12345-0@lo:101:mount.lustre.0 Request processed in 159us (9913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791801.433873:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788791801.434072:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3082d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630498944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791801.434093:0:18877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb92d200/0xcd6380150a32447b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324482 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791801.434103:0:18877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb92d200/0xcd6380150a32447b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a324482 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791801.434189:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630499072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791801.434224:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791801.440064:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9924f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788791801.440828:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630499072 00000100:00100000:1.0:1788791801.440838:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630499072 00000100:00100000:1.0:1788791801.440888:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788791801.440897:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18877:x1875683630499072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788791801.441215:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18877:x1875683630499072:12345-0@lo:501:mount.lustre.0 Request processed in 317us (6989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791801.441225:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788791801.441378:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630499072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791801.441429:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630499200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788791801.441474:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791801.441506:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9924f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788791801.445568:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630499200 00000100:00100000:0.0:1788791801.445582:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630499200 00000100:00100000:0.0:1788791801.445767:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788791801.445779:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18877:x1875683630499200:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788791801.446031:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18877:x1875683630499200:12345-0@lo:503:mount.lustre.0 Request processed in 253us (4555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791801.446039:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788791801.446198:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630499200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788791801.451998:0:18926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18926:1875683630499328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791801.452082:0:18926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791801.452148:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630499328 00000100:00100000:0.0:1788791801.452156:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630499328 00000100:00100000:0.0:1788791801.452203:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788791801.452213:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18926:x1875683630499328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791801.452473:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18926:x1875683630499328:12345-0@lo:502:llog_process_th.0 Request processed in 260us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791801.452481:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788791801.452822:0:18926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788791801.452845:0:18926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18926:1875683630499328:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788791801.452910:0:18926:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788791801.452927:0:18926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ababb06b370) 00000020:00000080:0.0:1788791801.452951:0:18926:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788791801.453036:0:18926:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9abab29de000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788791801.453041:0:18926:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9abab29de000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788791801.453043:0:18926:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9abab29de000 4 00010000:00080000:0.0:1788791801.453065:0:18926:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9aba993ae800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1788791801.457580:0:18926:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788791801.457925:0:18926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788791801.457963:0:18926:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788791801.457974:0:18926:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcd6380150a324490 00000100:00080000:2.0:1788791801.457984:0:18926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788791801.457991:0:18926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9aba993ae800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788791801.458026:0:18926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb711f80 x1875683630499456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788791801.458071:0:18926:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788791801.458370:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630499456:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788791801.458444:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791801.458820:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630499456 00000100:00100000:0.0:1788791801.458829:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630499456 00000100:00100000:0.0:1788791801.458904:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788791801.458911:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875683630499456:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788791801.458973:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875683630499456:12345-0@lo:38:llog_process_th.0 Request processed in 61us (528us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788791801.458980:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788791801.461098:0:18926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18926:1875683630499584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791801.461226:0:18926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791801.461266:0:18926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8661c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788791801.461463:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630499584 00000100:00100000:2.0:1788791801.461471:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630499584 00000100:00100000:2.0:1788791801.461596:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788791801.461607:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18926:x1875683630499584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791801.461929:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18926:x1875683630499584:12345-0@lo:502:llog_process_th.0 Request processed in 323us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791801.461937:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788791801.461995:0:18926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18926:1875683630499584:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788791801.462022:0:18926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:0.0:1788791801.462255:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788791801.462263:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9aba993ae800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788791801.462268:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788791801.462272:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630499456:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788791801.462296:0:18877:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788791801.462327:0:18877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788791801.462348:0:18877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb92d200/0xcd6380150a32447b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324482 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.462359:0:18877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb92d200/0xcd6380150a32447b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324482 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788791801.462406:0:18877:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788791801.462408:0:18877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788791801.462413:0:18877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791801.462414:0:18877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791801.462415:0:18877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791801.462417:0:18877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791801.462418:0:18877:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788791801.462419:0:18877:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788791801.462421:0:18877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791801.462423:0:18877:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788791801.462427:0:18877:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788791801.462429:0:18877:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788791801.462430:0:18877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788791801.462430:0:18877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791801.462431:0:18877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791801.462432:0:18877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791801.462433:0:18877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791801.462434:0:18877:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788791801.462434:0:18877:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788791801.462435:0:18877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791801.462436:0:18877:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788791801.462455:0:18877:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788791801.462467:0:18877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfdbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630499712:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788791801.464155:0:18877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791801.464199:0:18877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791801.464482:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630499712 00000100:00100000:1.0:1788791801.464490:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630499712 00000100:00100000:1.0:1788791801.464542:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788791801.464551:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18877:x1875683630499712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788791801.464579:0:18888:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788791801.464597:0:18888:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788791801.510711:0:18888:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788791801.510733:0:18888:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788791801.510972:0:18911:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788791801.510978:0:18911:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788791801.511002:0:18911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.511023:0:18911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ababb16ce00/0xcd6380150a324466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a32445f expref: 12 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.511033:0:18911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.511074:0:18911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ababb16ce00/0xcd6380150a324466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a32445f expref: 12 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.511107:0:18911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ababb16ce00/0xcd6380150a324466 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a32445f expref: 12 pid: 18890 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791801.511124:0:18911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18911:1875683630499840:0@lo:104: 00000100:00100000:0.0:1788791801.511238:0:18911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791801.511283:0:18911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03480 going to sleep for 11 seconds 00000100:00100000:0.0:1788791801.511337:0:18878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630499840 00000100:00100000:0.0:1788791801.511345:0:18878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630499840 00000100:00100000:0.0:1788791801.511407:0:18878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788791801.511417:0:18878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:18911:x1875683630499840:12345-0@lo:104: 00010000:00010000:0.0:1788791801.511430:0:18878:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a324466 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.511494:0:18878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788791801.511501:0:18878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:18911:x1875683630499840:12345-0@lo:104: Request processed in 86us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791801.511509:0:18878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788791801.511620:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791801.511628:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a324466 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791801.511636:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791801.511640:0:18884:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a324466 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791801.511648:0:18884:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a324466 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791801.511656:0:18884:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a324466 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791801.511662:0:18884:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788791801.511698:0:18884:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a324466 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791801.511716:0:18884:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791801.511744:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a324466 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791801.511750:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a32445f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a324466 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791801.511767:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791801.511768:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791801.511770:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791801.511972:0:18911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18911:1875683630499840:0@lo:104: 00000100:00100000:3.0:1788791801.511983:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3313:1875683630499968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791801.511992:0:18911:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791801.512023:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791801.512903:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630499968 00000100:00100000:0.0:1788791801.512912:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630499968 00010000:00010000:0.0:1788791801.512939:0:18880:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ababb16ce00/0xcd6380150a324466 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a32445f expref: 13 pid: 18890 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791801.512973:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788791801.512981:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+13:3313:x1875683630499968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791801.512993:0:18880:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791801.512998:0:18880:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ababb16ce00/0xcd6380150a324466 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a32445f expref: 13 pid: 18890 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.513021:0:18880:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ababb16ce00/0xcd6380150a324466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a32445f expref: 13 pid: 18890 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.513037:0:18880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16ce00/0xcd6380150a324466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a32445f expref: 13 pid: 18890 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.513051:0:18880:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.513059:0:18880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788791801.513072:0:18880:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002094948s 00010000:00010000:0.0:1788791801.513076:0:18880:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.513083:0:18880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.513089:0:18880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.513095:0:18880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.513101:0:18880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cb800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791801.513105:0:18880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.513112:0:18880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.513158:0:18880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791801.513170:0:18880:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791801.513176:0:18911:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791801.513187:0:18911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791801.513195:0:18911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba851cb800/0xcd6380150a324497 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791801.513227:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:3313:x1875683630499968:12345-0@lo:103:ldlm_bl.0 Request processed in 246us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791801.513235:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788791801.517226:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3313:1875683630499968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791801.539027:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:18877:x1875683630499712:12345-0@lo:253:mount.lustre.0 Request processed in 74466us (74867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791801.539043:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788791801.539210:0:18877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfdbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18877:1875683630499712:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788791801.539229:0:18877:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788791801.539232:0:18877:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788791801.539234:0:18877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788791801.539235:0:18877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788791801.539236:0:18877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788791801.539237:0:18877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788791801.539238:0:18877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788791801.539240:0:18877:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788791801.539241:0:18877:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788791801.539243:0:18877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788791801.539244:0:18877:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788791801.539260:0:18877:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788791801.548249:0:18877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788791801.548596:0:18877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788791801.548963:0:18877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788791801.549182:0:18877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788791801.549600:0:18877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788791801.549760:0:18877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788791801.550841:0:18877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788791801.551075:0:18877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788791801.551638:0:18877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788791801.552300:0:18877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788791801.552589:0:18877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788791801.552748:0:18877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788791801.608469:0:18877:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967527 00000040:01000000:3.0:1788791801.609003:0:18877:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788791801.609301:0:18933:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967527 00000020:00080000:0.0:1788791801.609317:0:18933:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000040:01000000:0.0:1788791801.609928:0:18934:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788791801.610011:0:18934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788791801.614163:0:18934:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788791801.614350:0:18934:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788791801.614355:0:18934:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788791801.615185:0:18877:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788791801.615372:0:18877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788791801.615873:0:18877:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788791801.615881:0:18877:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788791801.616019:0:18877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788791801.621342:0:18877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788791801.622215:0:18877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788791801.622254:0:18877:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788791801.623939:0:18877:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788791801.625177:0:18877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:2.0:1788791801.641105:0:18877:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788791801.692716:0:18877:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788791801.692750:0:18877:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadda417b7988 00100000:10000000:2.0:1788791801.692757:0:18877:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788791801.693500:0:18877:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788791801.693515:0:18877:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788791801.693529:0:18877:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788791801.693566:0:18877:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788791802.149317:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788791802.467407:0:18928:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788791802.467418:0:18928:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788791802.468007:0:18928:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788791802.468016:0:18928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788791803.171517:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788791803.176024:0:18892:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788791803.176032:0:18892:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9abab29de000 from 9 10000000:01000000:0.0:1788791803.176038:0:18892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788791803.176085:0:18892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791803.176110:0:18892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791803.176144:0:18892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791803.176227:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630500096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788791803.176304:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791803.176350:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03840 going to sleep for 11 seconds 00000100:00100000:2.0:1788791803.176499:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630500096 00000100:00100000:2.0:1788791803.176513:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630500096 00000100:00100000:2.0:1788791803.176568:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788791803.176578:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:18892:x1875683630500096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791803.176669:0:18889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791803.176685:0:18889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ff600/0xcd6380150a3244a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a32449e expref: -99 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791803.176709:0:18889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff600/0xcd6380150a3244a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a32449e expref: 12 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791803.176719:0:18889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ff600/0xcd6380150a3244a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a32449e expref: 12 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791803.176729:0:18889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff600, rc 0) 00000100:00100000:2.0:1788791803.176770:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18892:x1875683630500096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791803.176776:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788791803.176865:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630500096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791803.176880:0:18892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3244a5 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791803.176889:0:18892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a3244a5 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791803.176940:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630500224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788791803.176971:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791803.177941:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03840 going to sleep for 11 seconds 00000100:00100000:2.0:1788791803.178256:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630500224 00000100:00100000:2.0:1788791803.178264:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630500224 00000100:00100000:2.0:1788791803.178373:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788791803.178393:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18892:x1875683630500224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788791803.178415:0:18888:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788791803.178431:0:18888:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788791803.178434:0:18888:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788791803.178544:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18892:x1875683630500224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 161us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791803.178552:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788791803.178669:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630500224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788791803.178721:0:18892:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788791803.178731:0:18892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3244a5 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791803.178741:0:18892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3244a5 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788791803.491371:0:18928:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788791803.491538:0:18928:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788791803.491948:0:18928:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1788791803.492002:0:18928:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788791803.492030:0:18928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:0.0:1788791804.200501:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791805.219308:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788791805.647538:0:19177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788791806.244696:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788791806.761918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788791806.761925:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788791806.761928:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788791806.761931:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788791806.761934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788791806.761946:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788791806.761951:0:8:0:(import.c:65:import_set_state_nolock()) ffff9aba993ae800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788791806.761966:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9aba993ae800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788791806.761992:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9abab3080000 x1875683630500480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788791806.762061:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3314:1875683630500352:0@lo:400:kworker.0 00000100:00100000:1.0:1788791806.762154:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791806.762237:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630500352 00000100:00100000:1.0:1788791806.762245:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630500352 00000100:00100000:1.0:1788791806.762285:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788791806.762293:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:3314:x1875683630500352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791806.762337:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:3314:x1875683630500352:12345-0@lo:400:kworker.0 Request processed in 44us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791806.762344:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788791806.762381:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630500480:0@lo:38:kworker.0 00000100:00100000:1.0:1788791806.762410:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791806.762463:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630500480 00000100:00100000:1.0:1788791806.762468:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630500480 00000100:00100000:1.0:1788791806.762493:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788791806.762498:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875683630500480:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788791806.762519:0:18897:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 583 last 0 00000020:00000080:1.0:1788791806.762553:0:18897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcd6380150a3244ac 00000004:00100000:1.0:1788791806.762567:0:18897:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788791806.762731:0:18897:0:(import.c:65:import_set_state_nolock()) ffff9aba98071800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788791806.762772:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875683630500480:12345-0@lo:38:kworker.0 Request processed in 272us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791806.762787:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788791806.762826:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9abab3080000 x1875683630500480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788791816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788791806.762840:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788791806.762847:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788791806.762850:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788791806.762852:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9aba993ae800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788791806.762857:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630500480:0@lo:38:kworker.0 00000100:00100000:1.0:1788791806.762989:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3314:1875683630500352:0@lo:400:kworker.0 00010000:00010000:1.0:1788791807.267347:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791808.299972:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788791808.688668:0:19329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed79272f0 20000000:00000080:2.0:1788791808.688688:0:19329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ababb77b000 uarg=0000000000000000 20000000:01000000:2.0:1788791808.688731:0:19329:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788791808.688738:0:19329:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788791808.688742:0:19329:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788791808.690635:0:19330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788791808.690767:0:19329:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788791808.695726:0:19329:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788791808.698643:0:19329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791808.698670:0:19329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba994fea00/0xcd6380150a324474 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a32446d expref: 11 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791808.698678:0:19329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791808.698723:0:19329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba994fea00/0xcd6380150a324474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a32446d expref: 11 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791808.698736:0:19329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9aba994fea00/0xcd6380150a324474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a32446d expref: 11 pid: 18889 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791808.698751:0:19329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19329:1875683630500608:0@lo:104: 00000100:00100000:1.0:1788791808.698829:0:19329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791808.698901:0:19329:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788791808.699376:0:18878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630500608 00000100:00100000:0.0:1788791808.699386:0:18878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630500608 00000100:00100000:0.0:1788791808.699453:0:18878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788791808.699464:0:18878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:19329:x1875683630500608:12345-0@lo:104: 00010000:00010000:0.0:1788791808.699477:0:18878:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a324474 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791808.699562:0:18878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788791808.699569:0:18878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:19329:x1875683630500608:12345-0@lo:104: Request processed in 108us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791808.699576:0:18878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788791808.699596:0:19329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19329:1875683630500608:0@lo:104: 00010000:00010000:1.0:1788791808.699616:0:19329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.699668:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791808.699675:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a324474 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.699682:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16de00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791808.699686:0:18884:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a324474 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.699694:0:18884:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a324474 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791808.699702:0:18884:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a324474 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791808.699708:0:18884:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788791808.699745:0:18884:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a324474 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.699763:0:18884:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791808.699795:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a324474 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.699803:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a32446d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a324474 expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.699821:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791808.699823:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791808.699831:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791808.699887:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3315:1875683630500736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791808.699923:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791808.700023:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630500736 00000100:00100000:2.0:1788791808.700027:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630500736 00010000:00010000:2.0:1788791808.700050:0:18881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba994fea00/0xcd6380150a324474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a32446d expref: 12 pid: 18889 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791808.700082:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788791808.700089:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:3315:x1875683630500736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788791808.700101:0:18881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791808.700106:0:18881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba994fea00/0xcd6380150a324474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a32446d expref: 12 pid: 18889 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.700117:0:18881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba994fea00/0xcd6380150a324474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a32446d expref: 12 pid: 18889 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.700152:0:18881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994fea00/0xcd6380150a324474 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a32446d expref: 12 pid: 18889 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.700165:0:18881:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.700173:0:18881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.700203:0:18881:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.700211:0:18881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.700218:0:18881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.700236:0:18881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.700242:0:18881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92de00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791808.700247:0:18881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.700254:0:18881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.700266:0:18881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791808.700275:0:18881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791808.700308:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:3315:x1875683630500736:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791808.700315:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791808.700459:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3315:1875683630500736:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791808.700532:0:19329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791808.700541:0:19329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791808.700548:0:19329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb92de00/0xcd6380150a3244b3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791809.322717:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791810.340223:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788791810.597270:0:18892:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788791810.597288:0:18892:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9abab29de000 from 10 10000000:01000000:2.0:1788791810.597294:0:18892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788791810.597338:0:18892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791810.597352:0:18892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791810.597363:0:18892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791810.597553:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630500864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788791810.597626:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791810.597681:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791810.597740:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630500864 00000100:00100000:3.0:1788791810.597747:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630500864 00000100:00100000:3.0:1788791810.597806:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788791810.597816:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+11:18892:x1875683630500864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791810.597832:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791810.597847:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16d400/0xcd6380150a3244c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a3244ba expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791810.597869:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16d400/0xcd6380150a3244c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a3244ba expref: 12 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791810.597879:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16d400/0xcd6380150a3244c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3244ba expref: 12 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791810.597903:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d400, rc 0) 00000100:00100000:3.0:1788791810.597944:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18892:x1875683630500864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791810.597950:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788791810.598028:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630500864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791810.598042:0:18892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3244c1 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791810.598050:0:18892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a3244c1 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791810.598107:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630500992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791810.598161:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791810.598179:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791810.598231:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630500992 00000100:00100000:3.0:1788791810.598236:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630500992 00000100:00100000:3.0:1788791810.598265:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788791810.598271:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18892:x1875683630500992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791810.598669:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18892:x1875683630500992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791810.598676:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788791810.598742:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630500992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791810.598772:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630501120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791810.598808:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791810.598838:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791810.598879:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630501120 00000100:00100000:3.0:1788791810.598883:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630501120 00000100:00100000:3.0:1788791810.598915:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788791810.598922:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18892:x1875683630501120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791810.599053:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:18892:x1875683630501120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791810.599060:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788791810.599165:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630501120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788791810.600167:0:19410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788791810.600469:0:18892:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788791810.600490:0:18892:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788791810.600499:0:18892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3244c1 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791810.600509:0:18892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3244c1 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791811.363406:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791811.875265:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791801/real 1788791801] req@ffff9abab3081500 x1875683630497792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791811 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791811.875295:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9abab3081500 x1875683630497792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791811 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791811.875305:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791801/real 1788791801] req@ffff9abab3083100 x1875683630497664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791811 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791811.875316:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9abab3083100 x1875683630497664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791811 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788791811.875333:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ababb9ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788791811.875354:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788791811.875358:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630497792:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788791811.875364:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9aba98e49000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788791811.875369:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788791811.875372:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630497664:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788791811.875944:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788791811.875950:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788791811.875952:0:36:0:(import.c:65:import_set_state_nolock()) ffff9aba98e49000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788791811.875958:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 577 00000100:00080000:1.0:1788791811.875963:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788791811.875970:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9aba98e49000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788791811.875990:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9abab3081880 x1875683630501376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788791811.876006:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788791811.876009:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788791811.876010:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ababb9ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788791811.876013:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 577 00000100:00080000:1.0:1788791811.876027:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788791811.876032:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ababb9ae000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788791811.876043:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9abab3083800 x1875683630501504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788791811.876074:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630501632:0@lo:400:kworker.0 00000100:00100000:1.0:1788791811.876162:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791811.876229:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788791811.876235:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3313:1875683630501248:0@lo:400:kworker.0 00000100:00100000:1.0:1788791811.876407:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791811.876617:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630501632 00000100:00100000:1.0:1788791811.876625:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630501632 00000100:00100000:1.0:1788791811.876671:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788791811.876682:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630501632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791811.876748:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630501632:12345-0@lo:400:kworker.0 Request processed in 68us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791811.876756:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788791811.876781:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630501376:0@lo:8:kworker.0 00000400:00000100:1.0:1788791811.876807:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683630501376 offset 0 length 520: 4 00000100:00100000:1.0:1788791811.876821:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630501504:0@lo:8:kworker.0 00000400:00000100:1.0:1788791811.876837:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683630501504 offset 0 length 520: 4 00010000:00080000:1.0:1788791811.876870:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9abab3080380 x1875683630501632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791811.876883:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630501632:0@lo:400:kworker.0 00000100:00100000:0.0:1788791811.883968:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630501248 00000100:00100000:0.0:1788791811.883996:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630501248 00000100:00100000:0.0:1788791811.884055:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788791811.884065:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:3313:x1875683630501248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791811.884665:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:3313:x1875683630501248:12345-0@lo:400:kworker.0 Request processed in 601us (8257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791811.884674:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788791811.886395:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3313:1875683630501248:0@lo:400:kworker.0 00010000:00010000:2.0:1788791812.392854:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791813.413834:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788791813.640982:0:19579:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788791813.640985:0:19579:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788791813.641104:0:19579:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9abab9a60800 00000020:01000004:3.0:1788791813.641119:0:19579:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788791813.641198:0:19579:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788791813.641213:0:19579:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9aba99380000) 00000020:00000080:3.0:1788791813.641229:0:19579:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788791813.666899:0:19579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788791813.667927:0:19579:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788791813.669289:0:19579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788791813.669867:0:19579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788791813.672973:0:19579:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1788791813.676879:0:19579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:0.0:1788791813.676997:0:19579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:0.0:1788791813.677849:0:19579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:0.0:1788791813.679484:0:19579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 718: rc = 0 00100000:10000000:0.0:1788791813.679887:0:19579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 718: rc = 0 00100000:10000000:0.0:1788791813.680363:0:19579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 718: rc = 0 00100000:10000000:0.0:1788791813.680840:0:19579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 718: rc = 0 00100000:10000000:0.0:1788791813.681122:0:19579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 718: rc = 0 00100000:10000000:0.0:1788791813.681421:0:19579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 718: rc = 0 00000020:00000080:0.0:1788791813.684743:0:19579:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788791813.684755:0:19579:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788791813.684766:0:19579:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd6380150a3244cf 00000020:01000004:0.0:1788791813.684775:0:19579:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788791813.684795:0:19579:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788791813.684799:0:19579:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788791813.684805:0:19579:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788791813.684810:0:19579:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788791813.684823:0:19579:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ababb06cd28) 00000020:00000080:0.0:1788791813.684834:0:19579:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788791813.686350:0:19579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788791813.686593:0:19579:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788791813.686599:0:19579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788791813.689691:0:19579:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788791813.689706:0:19579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788791813.697753:0:19579:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788791813.697767:0:19579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788791813.699295:0:19579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788791813.700311:0:19579:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788791813.700319:0:19579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788791813.704892:0:19579:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788791813.704907:0:19579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788791813.740772:0:19579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788791813.741003:0:19579:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788791813.741010:0:19579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000040:00080000:3.0:1788791813.744924:0:18928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788791813.745887:0:19579:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788791813.745899:0:19579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788791813.747019:0:19579:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788791813.747030:0:19579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788791813.749387:0:19579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788791813.749633:0:19579:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788791813.749639:0:19579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788791813.750362:0:19579:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788791813.750370:0:19579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788791813.805394:0:19579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788791813.805960:0:19579:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788791813.805967:0:19579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788791813.811227:0:19579:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788791813.811243:0:19579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788791813.812046:0:19579:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788791813.812070:0:19579:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788791813.812075:0:19579:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788791813.839480:0:19579:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788791813.839521:0:19579:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788791813.839525:0:19579:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788791813.839527:0:19579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788791813.839529:0:19579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788791813.839530:0:19579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788791813.839531:0:19579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788791813.839533:0:19579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788791813.839534:0:19579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788791813.839536:0:19579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788791813.839538:0:19579:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788791813.839541:0:19579:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788791813.839544:0:19579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788791813.839551:0:19579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788791813.839552:0:19579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788791813.839553:0:19579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788791813.839554:0:19579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788791813.839555:0:19579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788791813.839556:0:19579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788791813.839557:0:19579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788791813.839558:0:19579:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788791813.839596:0:19579:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788791813.839618:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630501760:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788791813.839700:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791813.840286:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2f629c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791813.840922:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630501760 00000100:00100000:2.0:1788791813.840932:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630501760 00000100:00100000:2.0:1788791813.840993:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788791813.841006:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:19579:x1875683630501760:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788791813.841290:0:18889:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788791813.841295:0:18889:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788791813.841299:0:18889:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788791813.852346:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:19579:x1875683630501760:12345-0@lo:253:mount.lustre.0 Request processed in 11334us (12635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791813.852363:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788791813.852527:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630501760:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788791813.852544:0:19579:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788791813.852547:0:19579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788791813.852549:0:19579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788791813.852551:0:19579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788791813.852552:0:19579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788791813.852553:0:19579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788791813.852555:0:19579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788791813.852556:0:19579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788791813.852558:0:19579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788791813.852560:0:19579:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788791813.852584:0:19579:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9abab9a60800 from lustre-OST0000 10000000:01000000:3.0:1788791813.852612:0:19579:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788791813.852615:0:19579:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788791813.852622:0:19579:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9aba88c619b8 local copy 00010000:00010000:3.0:1788791813.852632:0:19579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cae00/0xcd6380150a3243c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243cc expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791813.852936:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630501888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791813.852976:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791813.853066:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98e04780 going to sleep for 11 seconds 00000100:00100000:0.0:1788791813.853124:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630501888 00000100:00100000:0.0:1788791813.853155:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630501888 00000100:00100000:0.0:1788791813.853238:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788791813.853248:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:19579:x1875683630501888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791813.853423:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:19579:x1875683630501888:12345-0@lo:501:mount.lustre.0 Request processed in 176us (446us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788791813.853430:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788791813.853504:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630501888:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788791813.853519:0:19579:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788791813.853688:0:19579:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788791813.853696:0:19579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cae00/0xcd6380150a3243c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243cc expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791813.853705:0:19579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba851cae00/0xcd6380150a3243c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243cc expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791813.853727:0:19579:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9abab9a60800 10000000:01000000:2.0:1788791813.853738:0:19579:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788791813.853743:0:19579:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9aba88c619b8 10000000:01000000:2.0:1788791813.853746:0:19579:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788791813.853749:0:19579:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9aba88c619b8 from 1 10000000:01000000:2.0:1788791813.853752:0:19579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788791813.853778:0:19579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994ffe00/0xcd6380150a3244dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791813.853787:0:19579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994ffe00/0xcd6380150a3244dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791813.853797:0:19579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994ffe00/0xcd6380150a3244dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791813.853811:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788791813.853840:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791813.854099:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abaa0479f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791813.854214:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630502016 00000100:00100000:3.0:1788791813.854227:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630502016 00000100:00100000:3.0:1788791813.854254:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788791813.854260:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+12:19579:x1875683630502016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791813.854269:0:18890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791813.854282:0:18890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16cc00/0xcd6380150a3244e4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a3244dd expref: -99 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791813.854302:0:18890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16cc00/0xcd6380150a3244e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a3244dd expref: 13 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791813.854313:0:18890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16cc00/0xcd6380150a3244e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3244dd expref: 13 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791813.854321:0:18890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16cc00, rc 0) 00000100:00100000:3.0:1788791813.854361:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+13:19579:x1875683630502016:12345-0@lo:101:mount.lustre.0 Request processed in 100us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791813.854367:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788791813.854503:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788791813.854517:0:19579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994ffe00/0xcd6380150a3244dd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3244e4 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791813.854526:0:19579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994ffe00/0xcd6380150a3244dd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a3244e4 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791813.854543:0:19579:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788791813.854561:0:19579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994ffe00/0xcd6380150a3244dd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3244e4 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791813.854569:0:19579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994ffe00/0xcd6380150a3244dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3244e4 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791813.854587:0:19579:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788791813.854591:0:19579:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788791813.854596:0:19579:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788791813.854599:0:19579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788791813.854615:0:19579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe400/0xcd6380150a3244eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791813.854622:0:19579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fe400/0xcd6380150a3244eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791813.854631:0:19579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fe400/0xcd6380150a3244eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791813.854645:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788791813.854685:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791813.854704:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abaa0479f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791813.854807:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630502144 00000100:00100000:3.0:1788791813.854811:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630502144 00000100:00100000:3.0:1788791813.854829:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788791813.854835:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+13:19579:x1875683630502144:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791813.854841:0:18890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791813.854849:0:18890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16d600/0xcd6380150a3244f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a3244eb expref: -99 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791813.854864:0:18890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16d600/0xcd6380150a3244f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a3244eb expref: 14 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791813.854872:0:18890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16d600/0xcd6380150a3244f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3244eb expref: 14 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791813.854885:0:18890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d600, rc 0) 00000100:00100000:3.0:1788791813.854927:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+14:19579:x1875683630502144:12345-0@lo:101:mount.lustre.0 Request processed in 91us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791813.854934:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788791813.855012:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788791813.855024:0:19579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fe400/0xcd6380150a3244eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3244f2 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791813.855033:0:19579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe400/0xcd6380150a3244eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a3244f2 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788791813.855963:0:19579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788791813.857216:0:19579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788791813.857508:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788791813.857555:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788791813.857588:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788791813.857662:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788791813.857777:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788791813.857811:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788791813.857857:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788791813.857891:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788791813.857926:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788791813.857976:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788791813.858012:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788791813.858054:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788791813.858182:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788791813.858190:0:19579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788791813.858275:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791813.858336:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791813.858375:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8661c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788791813.858543:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630502272 00000100:00100000:0.0:1788791813.858551:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630502272 00000100:00100000:0.0:1788791813.858601:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788791813.858611:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+14:19579:x1875683630502272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791813.858957:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+14:19579:x1875683630502272:12345-0@lo:501:mount.lustre.0 Request processed in 347us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791813.858966:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788791813.859180:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788791813.859219:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788791813.859264:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791813.859289:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78daf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788791813.859888:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630502400 00000100:00100000:2.0:1788791813.859895:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630502400 00000100:00100000:2.0:1788791813.859928:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788791813.859937:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+14:19579:x1875683630502400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788791813.860301:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+14:19579:x1875683630502400:12345-0@lo:503:mount.lustre.0 Request processed in 364us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791813.860309:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788791813.860424:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502400:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788791813.861164:0:19579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788791813.861263:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791813.861317:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791813.861350:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78daf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788791813.861506:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630502528 00000100:00100000:0.0:1788791813.861513:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630502528 00000100:00100000:0.0:1788791813.861554:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788791813.861562:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+14:19579:x1875683630502528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788791813.861892:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+14:19579:x1875683630502528:12345-0@lo:502:mount.lustre.0 Request processed in 330us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791813.861900:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788791813.861983:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788791813.862241:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788791813.862287:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788791813.862320:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788791813.862370:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788791813.863661:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788791813.863928:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788791813.863996:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788791813.864051:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788791813.864086:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1788791813.864177:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1788791813.864218:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1788791813.864268:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1788791813.864316:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788791813.864390:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791813.864551:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788791813.864595:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630502656 00000100:00100000:0.0:1788791813.864602:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630502656 00000100:00100000:0.0:1788791813.864785:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788791813.864796:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+14:19579:x1875683630502656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788791813.865000:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+14:19579:x1875683630502656:12345-0@lo:502:mount.lustre.0 Request processed in 205us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791813.865007:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788791813.865081:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788791813.865198:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1788791813.865209:0:19579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788791813.866186:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788791813.866195:0:19593:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788791813.866202:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791813.866204:0:19593:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788791813.866209:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788791813.866225:0:19593:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ababc148000) 00000020:00000080:2.0:1788791813.866245:0:19593:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788791813.866250:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788791813.866324:0:19593:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9abab9a60800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788791813.866331:0:19593:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788791813.866339:0:19593:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd6380150a324500 00010000:00010000:2.0:1788791813.873395:0:19593:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788791813.874849:0:19593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934605 00080000:10000000:2.0:1788791813.877003:0:19593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1788791813.887821:0:19593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788791813.887833:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791813.887839:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791813.887841:0:19593:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788791813.887845:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788791813.887847:0:19593:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788791813.887849:0:19593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788791813.887851:0:19593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788791813.887852:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788791813.887854:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791813.887856:0:19593:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788791813.887858:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791813.887860:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791813.887861:0:19593:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788791813.887864:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788791813.887866:0:19593:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788791813.887868:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791813.887870:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791813.887872:0:19593:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788791813.887874:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791813.887875:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791813.887877:0:19593:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788791813.887880:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788791813.887938:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791813.887940:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791813.887941:0:19593:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788791813.887944:0:19593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788791813.888822:0:19579:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788791813.888855:0:19579:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788791813.888879:0:19579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe400/0xcd6380150a3244eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3244f2 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791813.888908:0:19579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fe400/0xcd6380150a3244eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3244f2 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791813.888916:0:19579:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9abab9a60800 from 1 10000000:01000000:2.0:1788791813.888919:0:19579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788791813.888953:0:19579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791813.888960:0:19579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791813.888971:0:19579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791813.888994:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788791813.889074:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791813.889194:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788791813.896290:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630502784 00000100:00100000:0.0:1788791813.896305:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630502784 00000100:00100000:0.0:1788791813.896364:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788791813.896374:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+14:19579:x1875683630502784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791813.896392:0:18890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791813.896423:0:18890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba851cb000/0xcd6380150a32450e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a324507 expref: -99 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791813.896453:0:18890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba851cb000/0xcd6380150a32450e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a324507 expref: 15 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791813.896465:0:18890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba851cb000/0xcd6380150a32450e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a324507 expref: 15 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791813.896475:0:18890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba851cb000, rc 0) 00000100:00100000:0.0:1788791813.896552:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+15:19579:x1875683630502784:12345-0@lo:101:mount.lustre.0 Request processed in 179us (7478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791813.896559:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788791813.897083:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788791813.897114:0:19579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32450e expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791813.897160:0:19579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a32450e expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788791813.898013:0:19579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1788791813.898596:0:19579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788791813.899013:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788791813.899295:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788791813.899364:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788791813.900898:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788791813.900984:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788791813.901050:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788791813.901102:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788791813.902626:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788791813.903241:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788791813.903253:0:19579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1788791813.903358:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791813.903560:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791813.903600:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788791813.903843:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630502912 00000100:00100000:0.0:1788791813.903850:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630502912 00000100:00100000:0.0:1788791813.903900:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788791813.903909:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+15:19579:x1875683630502912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791813.904202:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+15:19579:x1875683630502912:12345-0@lo:501:mount.lustre.0 Request processed in 293us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791813.904219:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788791813.904319:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb710380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630502912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791813.904364:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788791813.904418:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791813.904444:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98e043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791813.904865:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630503040 00000100:00100000:0.0:1788791813.904872:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630503040 00000100:00100000:0.0:1788791813.904899:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788791813.904907:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+15:19579:x1875683630503040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788791813.905065:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+15:19579:x1875683630503040:12345-0@lo:503:mount.lustre.0 Request processed in 158us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791813.905072:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788791813.905174:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503040:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788791813.906003:0:19579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788791813.906072:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788791813.906162:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791813.906186:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98e043c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791813.906533:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630503168 00000100:00100000:1.0:1788791813.906541:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630503168 00000100:00100000:1.0:1788791813.906577:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788791813.906586:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+15:19579:x1875683630503168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791813.906921:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+15:19579:x1875683630503168:12345-0@lo:502:mount.lustre.0 Request processed in 335us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791813.906928:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788791813.907567:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788791813.907947:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788791813.908002:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788791813.908045:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788791813.908080:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788791813.908186:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788791813.908237:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788791813.908274:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788791813.908310:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1788791813.908345:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788791813.908479:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791813.908521:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98e043c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791813.908613:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630503296 00000100:00100000:1.0:1788791813.908620:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630503296 00000100:00100000:1.0:1788791813.908662:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788791813.908672:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+15:19579:x1875683630503296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791813.908865:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+15:19579:x1875683630503296:12345-0@lo:502:mount.lustre.0 Request processed in 194us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791813.908872:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788791813.908921:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788791813.909017:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788791813.909027:0:19579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788791813.910363:0:19597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788791813.910373:0:19597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791813.910375:0:19597:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788791813.910382:0:19597:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9abab9a60800 00000020:00000080:1.0:1788791813.910385:0:19597:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788791813.910393:0:19597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788791813.910395:0:19597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791813.910397:0:19597:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788791813.910399:0:19597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788791813.910401:0:19597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791813.910402:0:19597:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788791813.910406:0:19597:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9abab9a60800 00000020:00000080:1.0:1788791813.910408:0:19597:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788791813.910851:0:19597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788791813.910858:0:19597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791813.910860:0:19597:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788791813.910863:0:19597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788791813.910865:0:19597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791813.910866:0:19597:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788791813.910869:0:19597:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9abab9a60800 00000020:00000080:1.0:1788791813.910871:0:19597:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788791813.918173:0:19597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791813.918185:0:19597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791813.918188:0:19597:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788791813.918200:0:19597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:0.0:1788791813.918367:0:19579:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788791813.918410:0:19579:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788791813.918432:0:19579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32450e expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791813.918444:0:19579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32450e expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791813.918491:0:19579:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788791813.918494:0:19579:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9abab9a60800 10000000:01000000:0.0:1788791813.918497:0:19579:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9abab9a60800 10000000:01000000:0.0:1788791813.918511:0:19579:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788791813.918518:0:19579:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9abab9a60800 from 1 10000000:01000000:0.0:1788791813.918521:0:19579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788791813.918557:0:19579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cb800/0xcd6380150a324515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791813.918567:0:19579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba851cb800/0xcd6380150a324515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791813.918578:0:19579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba851cb800/0xcd6380150a324515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791813.918610:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503424:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788791813.918867:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791813.918918:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba891d2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788791813.919394:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630503424 00000100:00100000:1.0:1788791813.919403:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630503424 00000100:00100000:1.0:1788791813.919445:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788791813.919455:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+15:19579:x1875683630503424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788791813.919469:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791813.919482:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb92ce00/0xcd6380150a32451c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a324515 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791813.919519:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb92ce00/0xcd6380150a32451c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a324515 expref: 16 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791813.919530:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb92ce00/0xcd6380150a32451c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a324515 expref: 16 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791813.919540:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92ce00, rc 0) 00000100:00100000:1.0:1788791813.919679:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:19579:x1875683630503424:12345-0@lo:101:mount.lustre.0 Request processed in 225us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791813.919763:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788791813.919798:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503424:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791813.919813:0:19579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba851cb800/0xcd6380150a324515 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32451c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791813.919823:0:19579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba851cb800/0xcd6380150a324515 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a32451c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788791813.920574:0:19579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:0.0:1788791813.923053:0:19579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788791813.924970:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788791813.925036:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788791813.925070:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788791813.925169:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788791813.925211:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788791813.925261:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788791813.925298:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788791813.925333:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788791813.925383:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788791813.928880:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788791813.928937:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788791813.929011:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788791813.929078:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788791813.929150:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788791813.929205:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788791813.929241:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788791813.929275:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788791813.929337:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788791813.929377:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788791813.929412:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788791813.929459:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788791813.929496:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788791813.929567:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788791813.929620:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788791813.929657:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:0.0:1788791813.933017:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:0.0:1788791813.933114:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:0.0:1788791813.933179:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:0.0:1788791813.933231:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:0.0:1788791813.933282:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:0.0:1788791813.933320:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:0.0:1788791813.933355:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:0.0:1788791813.933388:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:0.0:1788791813.935273:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:0.0:1788791813.935326:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:0.0:1788791813.935393:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:0.0:1788791813.935912:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:0.0:1788791813.935945:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:0.0:1788791813.935993:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:0.0:1788791813.936028:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:0.0:1788791813.936173:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:0.0:1788791813.936181:0:19579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1788791813.936274:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791813.936340:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791813.936387:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba891d2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788791813.936777:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630503552 00000100:00100000:2.0:1788791813.936785:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630503552 00000100:00100000:2.0:1788791813.940074:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788791813.940138:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:19579:x1875683630503552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791813.941023:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:19579:x1875683630503552:12345-0@lo:501:mount.lustre.0 Request processed in 934us (4679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791813.941043:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788791813.941314:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791813.941367:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788791813.941425:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791813.941456:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba891d2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788791813.943537:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630503680 00000100:00100000:1.0:1788791813.943550:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630503680 00000100:00100000:1.0:1788791813.943614:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788791813.943624:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:19579:x1875683630503680:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788791813.946272:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:19579:x1875683630503680:12345-0@lo:503:mount.lustre.0 Request processed in 2633us (4829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791813.946273:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788791813.946285:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:0.0:1788791813.947246:0:19579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788791813.947339:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788791813.947387:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791813.947415:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba891d2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788791813.947632:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630503808 00000100:00100000:2.0:1788791813.947650:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630503808 00000100:00100000:2.0:1788791813.947700:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788791813.947709:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:19579:x1875683630503808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788791813.947986:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:19579:x1875683630503808:12345-0@lo:502:mount.lustre.0 Request processed in 277us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791813.947995:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788791813.949481:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788791813.950245:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788791813.950313:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788791813.950349:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788791813.950414:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788791813.950456:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788791813.950512:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788791813.950552:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788791813.950856:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788791813.951045:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788791813.951172:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788791813.951207:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788791813.951250:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788791813.951282:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788791813.951316:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788791813.951361:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788791813.951454:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788791813.951512:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788791813.951565:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788791813.952957:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788791813.953004:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788791813.953065:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788791813.953112:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788791813.953168:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788791813.953217:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788791813.953250:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:1.0:1788791813.953281:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:1.0:1788791813.953325:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:1.0:1788791813.953359:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:1.0:1788791813.953393:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:1.0:1788791813.956283:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:1.0:1788791813.956333:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:1.0:1788791813.956367:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:1.0:1788791813.957594:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:1.0:1788791813.957832:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:1.0:1788791813.957878:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:1.0:1788791813.957933:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:1.0:1788791813.957974:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:1.0:1788791813.958008:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:1.0:1788791813.958063:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:1.0:1788791813.958521:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:1.0:1788791813.958578:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791813.959494:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791813.959541:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba82bac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791813.959634:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630503936 00000100:00100000:2.0:1788791813.959643:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630503936 00000100:00100000:2.0:1788791813.959825:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788791813.959835:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:19579:x1875683630503936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788791813.960069:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:19579:x1875683630503936:12345-0@lo:502:mount.lustre.0 Request processed in 235us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791813.960078:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788791813.960600:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630503936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788791813.960723:0:19579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:1.0:1788791813.960736:0:19579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788791813.964195:0:19602:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788791813.964212:0:19602:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9abab3e38000) 00000020:00000080:0.0:1788791813.964233:0:19602:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788791813.964311:0:19602:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9abab9a60800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788791813.964315:0:19602:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9abab9a60800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788791813.964318:0:19602:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9abab9a60800 3 00010000:00080000:0.0:1788791813.964344:0:19602:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9aba90a1d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1788791813.974750:0:19602:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788791813.974966:0:19602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788791813.975006:0:19602:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788791813.975021:0:19602:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcd6380150a32452a 00000100:00080000:1.0:1788791813.975033:0:19602:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788791813.975040:0:19602:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9aba90a1d800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788791813.975078:0:19602:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9abab3080380 x1875683630504064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788791813.975119:0:19602:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788791813.975370:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875683630504064:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788791813.975453:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791813.975842:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630504064 00000100:00100000:1.0:1788791813.975851:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630504064 00000100:00100000:1.0:1788791813.975898:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788791813.975907:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875683630504064:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788791813.975935:0:18896:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:1.0:1788791813.975969:0:18896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcd6380150a324531 00000004:00100000:1.0:1788791813.975986:0:18896:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788791813.976019:0:18896:0:(import.c:65:import_set_state_nolock()) ffff9abab7073800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788791813.976074:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875683630504064:12345-0@lo:38:llog_process_th.0 Request processed in 167us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791813.976082:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1788791813.976267:0:19602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:1.0:1788791813.976319:0:19579:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788791813.976345:0:19579:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788791813.976360:0:19579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cb800/0xcd6380150a324515 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32451c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791813.976370:0:19579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba851cb800/0xcd6380150a324515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32451c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788791813.976518:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9abab3080380 x1875683630504064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788791823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791813.976529:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788791813.976537:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788791813.976544:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788791813.976548:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788791813.976550:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9aba90a1d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788791813.976555:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875683630504064:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1788791813.976790:0:19579:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788791813.976793:0:19579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788791813.976794:0:19579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788791813.976795:0:19579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788791813.976797:0:19579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788791813.976798:0:19579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788791813.976800:0:19579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788791813.976802:0:19579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788791813.976803:0:19579:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788791813.976807:0:19579:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788791813.976810:0:19579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788791813.976811:0:19579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788791813.976812:0:19579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788791813.976813:0:19579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788791813.976814:0:19579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788791813.976816:0:19579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788791813.976817:0:19579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788791813.976818:0:19579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788791813.976819:0:19579:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788791813.976837:0:19579:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788791813.976853:0:19579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630504192:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788791813.976895:0:19579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791813.976922:0:19579:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9474a600 going to sleep for 11 seconds 00000100:00080000:0.0:1788791813.977204:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788791813.977217:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788791813.977219:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788791813.977221:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788791813.977272:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788791813.977281:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630504320:0@lo:400:kworker.0 00000100:00100000:0.0:1788791813.977310:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791813.977341:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630504320 00000100:00100000:0.0:1788791813.977346:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630504320 00000100:00100000:0.0:1788791813.977378:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788791813.977385:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630504320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791813.977436:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630504320:12345-0@lo:400:kworker.0 Request processed in 51us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791813.977443:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788791813.977473:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ababbfd8e00 x1875683630504320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791813.977483:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630504320:0@lo:400:kworker.0 00000100:00100000:2.0:1788791813.980522:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630504192 00000100:00100000:2.0:1788791813.980537:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630504192 00000100:00100000:2.0:1788791813.980594:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788791813.980605:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:19579:x1875683630504192:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788791813.980638:0:18889:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788791813.980654:0:18889:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788791814.016985:0:18889:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788791814.017040:0:18889:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788791814.017157:0:18911:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788791814.017164:0:18911:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788791814.017187:0:18911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791814.017223:0:18911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba994ff600/0xcd6380150a3244a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a32449e expref: 16 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791814.017232:0:18911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791814.017274:0:18911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba994ff600/0xcd6380150a3244a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a32449e expref: 16 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791814.017288:0:18911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9aba994ff600/0xcd6380150a3244a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a32449e expref: 16 pid: 18889 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791814.017304:0:18911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3082680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18911:1875683630504448:0@lo:104: 00000100:00100000:1.0:1788791814.017373:0:18911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791814.017505:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630504448 00000100:00100000:2.0:1788791814.017513:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630504448 00000100:00100000:2.0:1788791814.017568:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788791814.017579:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:18911:x1875683630504448:12345-0@lo:104: 00010000:00010000:2.0:1788791814.017592:0:18879:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a3244a5 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791814.017769:0:18911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba891d2e40 going to sleep for 11 seconds 00010000:00010000:2.0:1788791814.018804:0:18879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788791814.018814:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:18911:x1875683630504448:12345-0@lo:104: Request processed in 1237us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791814.018824:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788791814.018849:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791814.018855:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a3244a5 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.018864:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca000 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791814.018869:0:18884:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a3244a5 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.018887:0:18884:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a3244a5 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791814.018894:0:18884:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a3244a5 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791814.018900:0:18884:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788791814.018935:0:18884:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a3244a5 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.018943:0:18884:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791814.018963:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a3244a5 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.018970:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba851ca000/0xcd6380150a32449e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a3244a5 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.018987:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791814.018989:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791814.018991:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791814.018999:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791814.019012:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3314:1875683630504576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791814.019045:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791814.019097:0:18882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630504576 00000100:00100000:2.0:1788791814.019104:0:18882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630504576 00010000:00010000:2.0:1788791814.019155:0:18882:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba994ff600/0xcd6380150a3244a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a32449e expref: 17 pid: 18889 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791814.019178:0:18882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788791814.019193:0:18882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:3314:x1875683630504576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788791814.019205:0:18882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791814.019211:0:18882:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba994ff600/0xcd6380150a3244a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a32449e expref: 17 pid: 18889 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.019220:0:18882:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba994ff600/0xcd6380150a3244a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a32449e expref: 17 pid: 18889 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.019237:0:18882:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.019244:0:18882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788791814.019257:0:18882:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002094948s 00010000:00010000:2.0:1788791814.019260:0:18882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.019266:0:18882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.019272:0:18882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.019279:0:18882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.019285:0:18882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92d800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791814.019289:0:18882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.019305:0:18882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.019315:0:18882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791814.019324:0:18882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791814.019356:0:18882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:3314:x1875683630504576:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791814.019363:0:18882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788791814.019525:0:18911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ff600/0xcd6380150a3244a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a32449e expref: 16 pid: 18889 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791814.019535:0:18911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3082680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18911:1875683630504448:0@lo:104: 00010000:00010000:1.0:1788791814.019551:0:18911:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791814.019559:0:18911:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791814.019564:0:18911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791814.019570:0:18911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb92d800/0xcd6380150a324538 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791814.019618:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3314:1875683630504576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791814.031216:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+15:19579:x1875683630504192:12345-0@lo:253:mount.lustre.0 Request processed in 50602us (54309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791814.031231:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788791814.031353:0:19579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:19579:1875683630504192:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788791814.031369:0:19579:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788791814.031372:0:19579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788791814.031374:0:19579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788791814.031375:0:19579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791814.031376:0:19579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791814.031378:0:19579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791814.031379:0:19579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791814.031380:0:19579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788791814.031382:0:19579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791814.031384:0:19579:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788791814.031423:0:19579:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788791814.032096:0:19579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788791814.032307:0:19579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788791814.032488:0:19579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788791814.032891:0:19579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788791814.033040:0:19579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788791814.034253:0:19579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788791814.036775:0:19579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788791814.097283:0:19579:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788791814.097292:0:19579:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788791814.097325:0:19579:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788791814.097381:0:19579:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788791814.097395:0:19579:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788791814.097499:0:19579:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788791814.439861:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791815.459406:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788791815.907721:0:18892:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788791815.907728:0:18892:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9abab29de000 from 10 10000000:01000000:0.0:1788791815.907733:0:18892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788791815.907778:0:18892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791815.907790:0:18892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791815.907804:0:18892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791815.907845:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630504704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788791815.907917:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791815.907976:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab7a28780 going to sleep for 11 seconds 00000100:00100000:1.0:1788791815.908087:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630504704 00000100:00100000:1.0:1788791815.908096:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630504704 00000100:00100000:1.0:1788791815.908172:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788791815.908183:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+15:18892:x1875683630504704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788791815.908195:0:18890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791815.908210:0:18890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb92da00/0xcd6380150a324546 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a32453f expref: -99 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791815.908234:0:18890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb92da00/0xcd6380150a324546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a32453f expref: 16 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791815.908245:0:18890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb92da00/0xcd6380150a324546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a32453f expref: 16 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791815.908255:0:18890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92da00, rc 0) 00000100:00100000:1.0:1788791815.908310:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:18892:x1875683630504704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791815.908317:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788791815.908420:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630504704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791815.908437:0:18892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324546 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791815.908445:0:18892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a324546 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791815.908499:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630504832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788791815.908531:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791815.908561:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916d2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791815.908686:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630504832 00000100:00100000:1.0:1788791815.908692:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630504832 00000100:00100000:1.0:1788791815.908722:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788791815.908728:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:18892:x1875683630504832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788791815.908742:0:18889:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788791815.908758:0:18889:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788791815.908761:0:18889:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788791815.908850:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:18892:x1875683630504832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791815.908867:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788791815.909062:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630504832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788791815.909158:0:18892:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788791815.909167:0:18892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324546 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791815.909176:0:18892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324546 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791816.488766:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791817.511931:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791818.534406:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788791819.045478:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788791819.045486:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788791819.045488:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788791819.045491:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788791819.045549:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3312:1875683630504960:0@lo:400:kworker.0 00000100:00100000:1.0:1788791819.045634:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791819.045683:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791819.045690:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630505088:0@lo:400:kworker.0 00000100:00100000:1.0:1788791819.045736:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791819.045774:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630505216:0@lo:400:kworker.0 00000100:00100000:1.0:1788791819.045801:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791819.045837:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630504960 00000100:00100000:1.0:1788791819.045844:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630504960 00000100:00100000:1.0:1788791819.045886:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788791819.045894:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:3312:x1875683630504960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791819.045939:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:3312:x1875683630504960:12345-0@lo:400:kworker.0 Request processed in 46us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791819.045946:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788791819.045975:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630505088 00000100:00100000:1.0:1788791819.045978:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630505088 00000100:00100000:1.0:1788791819.046010:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630505216 00000100:00100000:1.0:1788791819.046013:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630505216 00000100:00100000:1.0:1788791819.046038:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788791819.046051:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630505088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791819.046080:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630505088:12345-0@lo:400:kworker.0 Request processed in 31us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791819.046086:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788791819.046097:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788791819.046102:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630505216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791819.046149:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630505216:12345-0@lo:400:kworker.0 Request processed in 25us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791819.046155:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788791819.046191:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9abab3081180 x1875683630505216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791819.046203:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630505216:0@lo:400:kworker.0 00010000:00080000:1.0:1788791819.046227:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9abab3080a80 x1875683630505088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791819.046235:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630505088:0@lo:400:kworker.0 00000100:00100000:1.0:1788791819.046244:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3312:1875683630504960:0@lo:400:kworker.0 00000100:00080000:1.0:1788791819.048181:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788791819.555292:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791820.579521:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788791820.981035:0:19944:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788791821.606790:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791822.627362:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791823.652292:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788791823.973571:0:18928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788791824.163863:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788791824.163870:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788791824.163887:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788791824.163890:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788791824.163950:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3315:1875683630505344:0@lo:400:kworker.0 00000100:00100000:1.0:1788791824.164021:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791824.164061:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630505344 00000100:00100000:0.0:1788791824.164069:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630505344 00000100:00100000:1.0:1788791824.164081:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630505472:0@lo:400:kworker.0 00000100:00100000:1.0:1788791824.164110:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791824.164112:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788791824.164122:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:3315:x1875683630505344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791824.164149:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791824.164155:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630505600:0@lo:400:kworker.0 00000100:00100000:1.0:1788791824.164177:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791824.164191:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:3315:x1875683630505344:12345-0@lo:400:kworker.0 Request processed in 71us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791824.164198:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788791824.164203:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630505472 00000100:00100000:1.0:1788791824.164206:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630505472 00000100:00100000:1.0:1788791824.164531:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630505600 00000100:00100000:1.0:1788791824.164535:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630505600 00000100:00100000:0.0:1788791824.164544:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3315:1875683630505344:0@lo:400:kworker.0 00000100:00100000:1.0:1788791824.164564:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788791824.164570:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630505472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791824.164582:0:18896:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788791824.164588:0:18896:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788791824.164603:0:18897:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788791824.164606:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630505472:12345-0@lo:400:kworker.0 Request processed in 36us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791824.164610:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788791824.164613:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788791824.164616:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630505600:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788791824.164630:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791824.164644:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630505600:12345-0@lo:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00010000:00080000:1.0:1788791824.164648:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9abab3081180 x1875683630505600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791824.164650:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788791824.164660:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630505600:0@lo:400:kworker.0 00010000:00080000:1.0:1788791824.164671:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9abab3080a80 x1875683630505472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791824.164678:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630505472:0@lo:400:kworker.0 00010000:00010000:1.0:1788791824.675702:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791825.699403:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791826.223933:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791811/real 1788791811] req@ffff9abab3081880 x1875683630501376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791826 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791826.223962:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9abab3081880 x1875683630501376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791826 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791826.223970:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791811/real 1788791811] req@ffff9abab3083800 x1875683630501504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791826 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791826.223981:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9abab3083800 x1875683630501504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791826 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788791826.223998:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9aba98e49000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788791826.224362:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788791826.224374:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630501376:0@lo:8:kworker.0 00000100:00080000:2.0:1788791826.224381:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ababb9ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788791826.224386:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788791826.224389:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630501504:0@lo:8:kworker.0 00000100:00080000:2.0:1788791826.224456:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788791826.224460:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788791826.224463:0:37:0:(import.c:65:import_set_state_nolock()) ffff9aba98e49000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788791826.224468:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 588 00000100:00080000:2.0:1788791826.224472:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788791826.224479:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9aba98e49000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788791826.224499:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb710a80 x1875683630505856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788791826.224511:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788791826.224514:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788791826.224515:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ababb9ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788791826.224518:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 588 00000100:00080000:2.0:1788791826.224520:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788791826.224524:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ababb9ae000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788791826.224534:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb712d80 x1875683630505984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788791826.224575:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3314:1875683630505728:0@lo:400:kworker.0 00000100:00100000:2.0:1788791826.224636:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791826.224682:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791826.224687:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630506112:0@lo:400:kworker.0 00000100:00100000:2.0:1788791826.224726:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791826.224754:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630506240:0@lo:400:kworker.0 00000100:00100000:2.0:1788791826.224778:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791826.224825:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630505728 00000100:00100000:2.0:1788791826.224833:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630505728 00000100:00100000:2.0:1788791826.224886:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788791826.224895:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:3314:x1875683630505728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791826.224939:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:3314:x1875683630505728:12345-0@lo:400:kworker.0 Request processed in 45us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791826.224947:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788791826.224977:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630506112 00000100:00100000:2.0:1788791826.224981:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630506112 00000100:00100000:2.0:1788791826.225001:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630506240 00000100:00100000:2.0:1788791826.225004:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630506240 00000100:00100000:2.0:1788791826.226225:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788791826.226236:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630506112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791826.226302:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630506112:12345-0@lo:400:kworker.0 Request processed in 68us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791826.226309:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788791826.226323:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788791826.226329:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630506240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791826.226360:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630506240:12345-0@lo:400:kworker.0 Request processed in 32us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791826.226366:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788791826.226392:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788791826.226423:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababb713480 x1875683630506240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791826.226450:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630506240:0@lo:400:kworker.0 00010000:00080000:2.0:1788791826.226483:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababb713100 x1875683630506112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791826.226491:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630506112:0@lo:400:kworker.0 00000100:00100000:2.0:1788791826.226499:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3314:1875683630505728:0@lo:400:kworker.0 00000100:00100000:2.0:1788791826.226517:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630505856:0@lo:8:kworker.0 00000100:00100000:2.0:1788791826.226546:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791826.226585:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630505984:0@lo:8:kworker.0 00000100:00100000:2.0:1788791826.226605:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791826.226649:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630505856 00000100:00100000:2.0:1788791826.226654:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630505856 00000100:00100000:2.0:1788791826.226669:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630505984 00000100:00100000:2.0:1788791826.226671:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630505984 00000100:00100000:2.0:1788791826.226679:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791826.226684:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875683630505856:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788791826.226705:0:19582:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 602 last 0 00000020:00000080:2.0:1788791826.226732:0:19582:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a32454d 00002000:00100000:2.0:1788791826.226745:0:19582:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9abaa0085800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788791826.231173:0:19582:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788791826.231182:0:19582:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788791826.231528:0:19582:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788791826.231561:0:19582:0:(import.c:65:import_set_state_nolock()) ffff9abaa0081000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788791826.231652:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875683630505856:12345-0@lo:8:kworker.0 Request processed in 4964us (5102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791826.231667:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791826.231701:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788791826.231708:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875683630505984:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788791826.231724:0:19582:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788791826.232059:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababb710a80 x1875683630505856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788791846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791826.232070:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788791826.232078:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788791826.232086:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788791826.232097:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788791826.232099:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9aba98e49000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788791826.232118:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788791826.232123:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630505856:0@lo:8:kworker.0 00000004:00080000:3.0:1788791826.232203:0:18918:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:3.0:1788791826.232222:0:18918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18918:1875683630506496:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788791826.232262:0:18918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791826.232287:0:18918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906949c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791826.232306:0:19580:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788791826.232312:0:19580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788791826.232412:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630506496 00000100:00100000:3.0:1788791826.232418:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630506496 00000100:00100000:3.0:1788791826.232511:0:20203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788791826.232520:0:20203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18918:x1875683630506496:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788791826.244749:0:20203:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788791826.244760:0:20203:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788791826.244765:0:20203:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00000004:00080000:2.0:1788791826.265890:0:18917:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788791826.266243:0:18917:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 602646114878ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788791826.267615:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630506368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791826.267691:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788791826.267745:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791826.268008:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875683630505984:12345-0@lo:8:kworker.0 Request processed in 36297us (41399us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788791826.268020:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788791826.268064:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ababb9ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788791826.268070:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788791826.268073:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630505984:0@lo:8:kworker.0 00000100:00100000:1.0:1788791826.272514:0:19584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630506368 00000100:00100000:1.0:1788791826.272532:0:19584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630506368 00000100:00100000:1.0:1788791826.272576:0:19584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788791826.272586:0:19584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875683630506368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791826.272622:0:19584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788791826.272917:0:19584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875683630506368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 331us (5225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791826.272924:0:19584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788791826.273387:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababb6d0380 x1875683630506368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791826.273408:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630506368:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1788791826.293344:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.293357:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a324554 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.293375:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.293380:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.293386:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a324554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.293402:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a324554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.293420:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a324554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.293427:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a324554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.294551:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788791826.296912:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.296925:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a324554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.296939:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16de00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.296944:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a324554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.296956:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a324554 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.296981:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a324554 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.296989:0:18883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a324554 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.297561:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.297564:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.297566:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.299310:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.299321:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4d13118/0xcd6380150a32455b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.299337:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.299342:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.299348:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d13118/0xcd6380150a32455b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.299361:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4d13118/0xcd6380150a32455b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.299371:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4d13118/0xcd6380150a32455b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.299379:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d13118/0xcd6380150a32455b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.299411:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788791826.300365:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.300375:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4d13118/0xcd6380150a32455b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.300386:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.300391:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d13118/0xcd6380150a32455b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.300401:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d13118/0xcd6380150a32455b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.300419:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4d13118/0xcd6380150a32455b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.300427:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4d13118/0xcd6380150a32455b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.301079:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.301082:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.301084:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.303322:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.303333:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324562 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.303351:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.303355:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.303362:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.303375:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.303385:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.303393:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.303414:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791826.303426:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791826.303431:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.303439:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16ce00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791826.304550:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.304563:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324562 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.304581:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324562 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.304589:0:18883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324562 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.304607:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.304609:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.304611:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.308764:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.308778:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324569 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.308795:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.308799:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.308806:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.309293:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.309304:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.309320:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.309339:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791826.309355:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791826.309360:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.309368:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791826.309373:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.309383:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.309398:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324569 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.309405:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324569 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.309423:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.309425:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.309426:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.311569:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.311588:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324570 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.311605:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.311609:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.311616:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.311629:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.311639:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.311647:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.311665:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791826.311679:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791826.311684:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.311693:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791826.311697:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.311706:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.311731:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324570 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.311738:0:18883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324570 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.311772:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.311775:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.311777:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.318955:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.318971:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324577 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.318990:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.318995:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.319745:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.319765:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.319776:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.319784:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.320544:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791826.320560:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791826.320566:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.320575:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791826.320579:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.320590:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324577 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.320607:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324577 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.320614:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324577 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.320632:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.320634:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.320636:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.325093:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.325106:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a32457e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.325123:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.325159:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.325166:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a32457e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.325885:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a32457e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.325900:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a32457e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.325910:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a32457e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.325928:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791826.325942:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791826.325947:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a32457e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.325955:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791826.325960:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a32457e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.325969:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a32457e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.325987:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a32457e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.326560:0:18883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a32457e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.326582:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.326584:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.326586:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.329388:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.329400:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324585 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.329416:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.329420:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.329426:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.329439:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.329890:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.329899:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.329918:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791826.329932:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791826.329944:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.329951:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16ce00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791826.329955:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.329963:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324585 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.329979:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324585 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.329986:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a324585 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.330550:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.330553:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.330555:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.332465:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.332477:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a32458c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.332493:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.332497:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.332504:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a32458c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.332530:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a32458c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.332540:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a32458c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.332549:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a32458c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.332579:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788791826.333068:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.333074:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a324593 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333083:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.333087:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.333091:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a324593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333101:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a324593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333110:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a324593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333153:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a324593 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333170:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788791826.333197:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788791826.333203:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a32458c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333211:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791826.333216:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a32458c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333225:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a32458c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333243:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a32458c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333251:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a32458c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333267:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791826.333270:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a324593 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333288:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791826.333291:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a324593 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333299:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a324593 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333311:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a324593 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333318:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a324593 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333331:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.333333:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.333335:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.333780:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.333786:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a32459a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333796:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.333800:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.333805:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a32459a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333815:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a32459a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333830:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a32459a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333837:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a32459a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333853:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791826.333863:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791826.333867:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a32459a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333888:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791826.333892:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a32459a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333900:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a32459a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333912:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a32459a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333919:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a32459a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.333933:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.333939:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.333941:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.334416:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.334423:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.334432:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.334436:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.334441:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.334450:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.334458:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.334465:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.334479:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791826.334487:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791826.334490:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.334496:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791826.334499:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.334517:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.334528:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.334535:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.334548:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.334549:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.334551:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.336418:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.345032:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.345046:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.345063:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.345067:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.345073:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.345088:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.345098:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.345112:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.345151:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791826.345166:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791826.345171:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.345178:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16ce00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791826.346005:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.346019:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.346039:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.346048:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.346071:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.346073:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.346075:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.346991:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.347008:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a3245af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.347022:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.347026:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.347033:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a3245af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.347045:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a3245af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.347054:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a3245af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.347063:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a3245af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.347086:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788791826.347290:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.347297:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a3245af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.347312:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.347316:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a3245af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.347324:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a3245af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.347338:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a3245af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.347345:0:18883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a3245af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.347363:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.347364:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.347366:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.348041:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.348049:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a3245b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.348060:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.348064:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.348068:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a3245b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.348077:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a3245b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.348091:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a3245b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.348097:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a3245b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.348152:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788791826.348557:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.348564:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a3245b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.348572:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16da00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.348576:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a3245b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.348586:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a3245b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.348608:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a3245b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.348616:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a3245b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.348632:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.348634:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.348637:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.349031:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.349038:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a3245bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.349048:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.349052:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.349058:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a3245bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.349068:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a3245bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.349076:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a3245bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.349084:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a3245bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.349120:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788791826.349287:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.349293:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a3245bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.349301:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.349305:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a3245bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.349313:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a3245bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.349326:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a3245bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.349334:0:18883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a3245bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.349363:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.349365:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.349367:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.350030:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.350037:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a3245c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.350049:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.350053:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.350058:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a3245c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.350067:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a3245c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.350076:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a3245c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.350082:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a3245c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.350190:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788791826.350960:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.350967:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.350978:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.350986:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.350991:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.351001:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.351010:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.351017:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.351587:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788791826.351595:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a3245c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.351604:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.351610:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a3245c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.351619:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a3245c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.351636:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a3245c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.351654:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a3245c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.351688:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.351692:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.351699:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16ca00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.351709:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.351718:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.351729:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.351738:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.351739:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.351741:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.354053:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788791826.354066:0:20203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.354105:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788791826.364573:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788791826.364926:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788791826.364937:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a3245d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791826.364954:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788791826.364959:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791826.364974:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a3245d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791826.364991:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a3245d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791826.365001:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a3245d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791826.365010:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a3245d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791826.365066:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788791826.365623:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788791826.365630:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a3245d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791826.366065:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=602s v=(0 0) 00010000:00010000:2.0:1788791826.366072:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791826.366077:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a3245d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791826.366090:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a3245d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791826.366100:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a3245d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791826.366122:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a3245d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.368108:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788791826.368120:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a3245d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.368152:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.368157:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a3245d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.368168:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a3245d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.368197:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a3245d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.368205:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a3245d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.368231:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.368235:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a3245d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.368241:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.368245:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a3245d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.368252:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a3245d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.368263:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a3245d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.368271:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.368273:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.368275:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791826.368472:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788791826.368480:0:20203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a3245d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.368594:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.369956:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.369966:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.369982:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.369986:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.369993:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.370018:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.370027:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.370035:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.370107:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788791826.370580:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.370586:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.370596:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.370599:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.370604:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.370613:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.370621:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.370638:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.371048:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788791826.371056:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.371065:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16ca00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.371070:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.371091:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.371107:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.371114:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d95723f/0xcd6380150a3245e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.371152:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.371156:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.371162:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16ce00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.371165:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.371172:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.371189:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.371196:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.371198:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.371205:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.371678:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788791826.371685:0:20203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3245e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791826.372234:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.372242:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.372253:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.372257:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.372262:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.372271:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.372281:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.372288:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.372732:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.372739:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.372748:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.372753:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.372761:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.372778:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.372787:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.372789:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.372791:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.372940:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788791826.372945:0:20203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001574c5f1/0xcd6380150a3245ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791826.373596:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.373603:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a3245f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.373614:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.373618:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.373622:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a3245f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.373632:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a3245f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.373720:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a3245f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.373730:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a3245f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.374117:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.374170:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a3245f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.374241:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.374247:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a3245f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.374256:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a3245f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.374285:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a3245f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.374295:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.374297:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.374299:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.374378:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788791826.374384:0:20203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e70bc1b/0xcd6380150a3245f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.374520:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791826.375334:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.375342:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a3245fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.375353:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.375357:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.375362:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a3245fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.375374:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a3245fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.375383:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a3245fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.375389:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a3245fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.375441:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788791826.376328:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.376335:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324603 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.376347:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.376351:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.376362:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.376373:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.376381:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.376387:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.376440:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788791826.376785:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a3245fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.376795:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.376800:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a3245fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.376912:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a3245fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.376930:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a3245fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.376942:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d443b5b2/0xcd6380150a3245fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.376961:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.376964:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324603 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.376979:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.376982:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324603 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.376990:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324603 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.377001:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324603 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.377009:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.377010:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.377012:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.377083:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788791826.377091:0:20203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd809e6b/0xcd6380150a324603 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791826.377906:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.377914:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a32460a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.377925:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.377928:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.377933:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a32460a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.377943:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a32460a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.377965:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a32460a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.377972:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a32460a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.378782:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.378791:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a32460a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.378801:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16dc00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.378864:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a32460a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.378884:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a32460a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.378902:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a32460a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.378921:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.378923:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.378925:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.379021:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788791826.379028:0:20203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a32460a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791826.379967:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.379976:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a324611 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.379990:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.379995:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.380001:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a324611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.380013:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a324611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.380022:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a324611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.380041:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a324611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.380530:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.380537:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a324611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.380546:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.380551:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a324611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.380559:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a324611 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.380575:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a324611 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.380586:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.380588:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.380590:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.380747:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788791826.380754:0:20203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa200129/0xcd6380150a324611 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791826.381564:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.381572:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a324618 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.381583:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.381586:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.381591:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a324618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.381602:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a324618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.381611:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a324618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.381618:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a324618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.381883:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.381890:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a324618 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.381897:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.381901:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a324618 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.381916:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a324618 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.381930:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a324618 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.381939:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.381941:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.381942:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.382013:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788791826.382018:0:20203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a324618 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791826.383072:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.383081:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a32461f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.383093:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.383098:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.383103:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a32461f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.383115:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a32461f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.383151:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a32461f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.383161:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a32461f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.383299:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.383306:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a32461f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.383314:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16da00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.383318:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a32461f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.383325:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a32461f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.383339:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a32461f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.383347:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.383349:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.383351:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.383426:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788791826.383431:0:20203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c412e02b/0xcd6380150a32461f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791826.383899:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791826.383904:0:20203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324626 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.383913:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788791826.383917:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791826.383921:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.383930:0:20203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.383937:0:20203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791826.383945:0:20203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.384308:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791826.384315:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324626 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.384323:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791826.384327:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324626 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.384334:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324626 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.384347:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324626 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.384355:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.384357:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791826.384359:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791826.384401:0:20203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788791826.384407:0:20203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a324626 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791826.384531:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788791826.385120:0:20203:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:3.0:1788791826.385441:0:20203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18918:x1875683630506496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 152918us (153174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791826.385473:0:20203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788791826.385612:0:18918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18918:1875683630506496:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788791826.385629:0:18918:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:2.0:1788791826.385756:0:18918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18918:1875683630506624:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788791826.385795:0:18918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791826.385946:0:18918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba995af000 going to sleep for 11 seconds 00000100:00100000:3.0:1788791826.385987:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630506624 00000100:00100000:3.0:1788791826.385994:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630506624 00000100:00100000:3.0:1788791826.386073:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788791826.386084:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18918:x1875683630506624:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788791826.386174:0:19580:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:2.0:1788791826.391620:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:18918:x1875683630506624:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5531us (5817us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788791826.391632:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788791826.391786:0:18918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18918:1875683630506624:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788791826.391801:0:18918:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:1.0:1788791826.724779:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791827.747429:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788791828.306454:0:20296:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788791828.306459:0:20296:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788791828.306570:0:20296:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9abaa0086000 00000020:01000004:2.0:1788791828.306585:0:20296:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788791828.306599:0:20296:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788791828.306614:0:20296:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ababc14cd28) 00000020:00000080:2.0:1788791828.306631:0:20296:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788791828.344880:0:20296:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788791828.346774:0:20296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788791828.347892:0:20296:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788791828.348119:0:20296:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788791828.348741:0:20296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1788791828.349074:0:20296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 499: rc = 0 00100000:10000000:2.0:1788791828.349329:0:20296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 499: rc = 0 00100000:10000000:2.0:1788791828.349648:0:20296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 499: rc = 0 00100000:10000000:2.0:1788791828.350742:0:20296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 648: rc = 0 00100000:10000000:2.0:1788791828.352660:0:20296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 648: rc = 0 00100000:10000000:2.0:1788791828.352954:0:20296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 648: rc = 0 00100000:10000000:2.0:1788791828.353388:0:20296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 648: rc = 0 00100000:10000000:2.0:1788791828.353858:0:20296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 648: rc = 0 00100000:10000000:2.0:1788791828.354119:0:20296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 648: rc = 0 00000020:00000080:2.0:1788791828.356159:0:20296:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788791828.356172:0:20296:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788791828.356183:0:20296:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd6380150a324634 00000020:01000004:2.0:1788791828.356191:0:20296:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788791828.356212:0:20296:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788791828.356215:0:20296:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788791828.356221:0:20296:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788791828.356242:0:20296:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788791828.356247:0:20296:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788791828.374937:0:20296:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788791828.374980:0:20296:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.129@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788791828.374985:0:20296:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788791828.374987:0:20296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788791828.374988:0:20296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791828.374989:0:20296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791828.374990:0:20296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791828.374992:0:20296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791828.374993:0:20296:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788791828.374995:0:20296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791828.374996:0:20296:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788791828.375004:0:20296:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788791828.375007:0:20296:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788791828.375008:0:20296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788791828.375009:0:20296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791828.375009:0:20296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791828.375010:0:20296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791828.375011:0:20296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791828.375012:0:20296:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788791828.375013:0:20296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791828.375014:0:20296:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788791828.375040:0:20296:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788791828.375061:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630506752:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788791828.375716:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791828.375822:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba85141600 going to sleep for 11 seconds 00000100:00100000:1.0:1788791828.375875:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630506752 00000100:00100000:1.0:1788791828.375883:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630506752 00000100:00100000:1.0:1788791828.375936:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788791828.375946:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:20296:x1875683630506752:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788791828.375977:0:18889:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788791828.375981:0:18889:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788791828.375984:0:18889:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788791828.386870:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:20296:x1875683630506752:12345-0@lo:253:mount.lustre.0 Request processed in 10911us (11142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791828.386884:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788791828.386890:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630506752:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788791828.386904:0:20296:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788791828.386907:0:20296:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788791828.386909:0:20296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788791828.386910:0:20296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791828.386911:0:20296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791828.386912:0:20296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791828.386913:0:20296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791828.386915:0:20296:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788791828.386917:0:20296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791828.386918:0:20296:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788791828.386938:0:20296:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9abaa0086000 from lustre-OST0001 10000000:01000000:0.0:1788791828.387767:0:20296:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788791828.387771:0:20296:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788791828.387779:0:20296:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9aba88c619b8 local copy 00010000:00010000:0.0:1788791828.387789:0:20296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cae00/0xcd6380150a3243c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243cc expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791828.388608:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630506880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791828.388664:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791828.388718:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2d7dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791828.388832:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630506880 00000100:00100000:2.0:1788791828.388848:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630506880 00000100:00100000:2.0:1788791828.388904:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788791828.388914:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:20296:x1875683630506880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791828.389100:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:20296:x1875683630506880:12345-0@lo:501:mount.lustre.0 Request processed in 187us (435us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788791828.389108:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788791828.389322:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfdb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630506880:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788791828.389342:0:20296:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788791828.389782:0:20296:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788791828.389792:0:20296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851cae00/0xcd6380150a3243c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243cc expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791828.389814:0:20296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba851cae00/0xcd6380150a3243c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3243cc expref: -99 pid: 18877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791828.389867:0:20296:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9abaa0086000 10000000:01000000:1.0:1788791828.389873:0:20296:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788791828.389879:0:20296:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788791828.389883:0:20296:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788791828.389889:0:20296:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788791828.389892:0:20296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788791828.389926:0:20296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb92d400/0xcd6380150a32463b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791828.389934:0:20296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb92d400/0xcd6380150a32463b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791828.389943:0:20296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb92d400/0xcd6380150a32463b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791828.389962:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788791828.389996:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791828.390031:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1840 going to sleep for 11 seconds 00000100:00100000:3.0:1788791828.390102:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630507008 00000100:00100000:3.0:1788791828.390109:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630507008 00000100:00100000:3.0:1788791828.390287:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788791828.390297:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:20296:x1875683630507008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791828.390308:0:18889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791828.390321:0:18889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16c800/0xcd6380150a324642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a32463b expref: -99 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791828.390342:0:18889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16c800/0xcd6380150a324642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a32463b expref: 17 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791828.390352:0:18889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16c800/0xcd6380150a324642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a32463b expref: 17 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791828.390643:0:18889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c800, rc 0) 00000100:00100000:3.0:1788791828.390734:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:20296:x1875683630507008:12345-0@lo:101:mount.lustre.0 Request processed in 437us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791828.390749:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788791828.390811:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788791828.390826:0:20296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb92d400/0xcd6380150a32463b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324642 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791828.390845:0:20296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb92d400/0xcd6380150a32463b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a324642 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788791828.391910:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1788791828.393375:0:20296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788791828.393713:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788791828.393762:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788791828.393794:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788791828.393862:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788791828.393900:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788791828.393931:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788791828.393978:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788791828.394015:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788791828.394064:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1788791828.394357:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1788791828.394368:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1788791828.394576:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788791828.394639:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791828.394748:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788791828.394859:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630507136 00000100:00100000:2.0:1788791828.394866:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630507136 00000100:00100000:2.0:1788791828.394941:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788791828.394951:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:20296:x1875683630507136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791828.395534:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:20296:x1875683630507136:12345-0@lo:501:mount.lustre.0 Request processed in 583us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791828.395543:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788791828.395897:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791828.395942:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788791828.395989:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791828.396060:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba89179d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791828.397852:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630507264 00000100:00100000:2.0:1788791828.397867:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630507264 00000100:00100000:2.0:1788791828.397933:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788791828.397943:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:20296:x1875683630507264:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788791828.400857:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:20296:x1875683630507264:12345-0@lo:503:mount.lustre.0 Request processed in 2904us (4856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791828.400871:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788791828.401842:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507264:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788791828.403806:0:20296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788791828.403905:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788791828.403984:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791828.404104:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba89179d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791828.404327:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630507392 00000100:00100000:1.0:1788791828.404335:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630507392 00000100:00100000:1.0:1788791828.404558:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788791828.404571:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:20296:x1875683630507392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791828.404817:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:20296:x1875683630507392:12345-0@lo:502:mount.lustre.0 Request processed in 248us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791828.404825:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788791828.404949:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788791828.405405:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788791828.405623:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788791828.405677:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788791828.405727:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788791828.405762:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788791828.405795:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788791828.405855:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788791828.405892:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788791828.405937:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788791828.405979:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788791828.406041:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791828.406813:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba89179d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788791828.406927:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630507520 00000100:00100000:0.0:1788791828.406936:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630507520 00000100:00100000:0.0:1788791828.406984:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788791828.406993:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:20296:x1875683630507520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788791828.407364:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:20296:x1875683630507520:12345-0@lo:502:mount.lustre.0 Request processed in 370us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791828.407372:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788791828.407675:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788791828.407777:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1788791828.407799:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788791828.410085:0:20297:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788791828.410097:0:20297:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788791828.410103:0:20297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791828.410106:0:20297:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788791828.410113:0:20297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788791828.410242:0:20297:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9aba88c63370) 00000020:00000080:1.0:1788791828.410268:0:20297:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788791828.410276:0:20297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788791828.410337:0:20297:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9abaa0086000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788791828.410344:0:20297:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788791828.410350:0:20297:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd6380150a324650 00010000:00010000:1.0:1788791828.419007:0:20297:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788791828.420664:0:20297:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:1.0:1788791828.426737:0:20297:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1788791828.436825:0:20297:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788791828.436850:0:20297:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791828.436858:0:20297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791828.436859:0:20297:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788791828.436863:0:20297:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791828.436867:0:20297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791828.436869:0:20297:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788791828.436871:0:20297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788791828.436873:0:20297:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788791828.436875:0:20297:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791828.436876:0:20297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791828.436878:0:20297:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788791828.436880:0:20297:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791828.436882:0:20297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791828.436883:0:20297:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788791828.436886:0:20297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788791828.436952:0:20297:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791828.436956:0:20297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791828.436957:0:20297:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788791828.436960:0:20297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788791828.437275:0:20296:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788791828.437309:0:20296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788791828.437331:0:20296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb92d400/0xcd6380150a32463b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324642 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791828.437344:0:20296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb92d400/0xcd6380150a32463b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324642 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791828.437352:0:20296:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9abaa0086000 from 1 10000000:01000000:3.0:1788791828.437356:0:20296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788791828.437525:0:20296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791828.437535:0:20296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791828.437547:0:20296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791828.437571:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788791828.437641:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791828.437721:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba89179600 going to sleep for 11 seconds 00000100:00100000:1.0:1788791828.443635:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630507648 00000100:00100000:1.0:1788791828.443652:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630507648 00000100:00100000:1.0:1788791828.443714:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788791828.443724:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:20296:x1875683630507648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788791828.443742:0:18889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791828.443761:0:18889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb92c800/0xcd6380150a32465e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a324657 expref: -99 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791828.443790:0:18889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb92c800/0xcd6380150a32465e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a324657 expref: 18 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791828.443801:0:18889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb92c800/0xcd6380150a32465e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a324657 expref: 18 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791828.443810:0:18889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92c800, rc 0) 00000100:00100000:1.0:1788791828.443901:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:20296:x1875683630507648:12345-0@lo:101:mount.lustre.0 Request processed in 178us (6259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791828.443908:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788791828.443959:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788791828.443978:0:20296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32465e expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791828.443999:0:20296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a32465e expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788791828.447791:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:1.0:1788791828.449241:0:20296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788791828.450049:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788791828.450105:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788791828.450624:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788791828.450692:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788791828.450761:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788791828.450829:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788791828.450879:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788791828.450915:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788791828.451003:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788791828.451014:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:1.0:1788791828.451150:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791828.453029:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791828.453090:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1780 going to sleep for 11 seconds 00000100:00100000:3.0:1788791828.457392:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630507776 00000100:00100000:3.0:1788791828.457409:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630507776 00000100:00100000:3.0:1788791828.457477:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788791828.457487:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:20296:x1875683630507776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791828.457841:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:20296:x1875683630507776:12345-0@lo:501:mount.lustre.0 Request processed in 344us (4805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791828.457863:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788791828.457882:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791828.457938:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788791828.457989:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791828.458026:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791828.458119:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630507904 00000100:00100000:1.0:1788791828.458166:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630507904 00000100:00100000:1.0:1788791828.458200:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788791828.458207:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:20296:x1875683630507904:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788791828.458368:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:20296:x1875683630507904:12345-0@lo:503:mount.lustre.0 Request processed in 160us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791828.458376:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788791828.458739:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630507904:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788791828.464050:0:20296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788791828.464181:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788791828.464264:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791828.464313:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916d29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791828.464595:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630508032 00000100:00100000:3.0:1788791828.464603:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630508032 00000100:00100000:3.0:1788791828.464649:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788791828.464659:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:20296:x1875683630508032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788791828.464892:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:20296:x1875683630508032:12345-0@lo:502:mount.lustre.0 Request processed in 233us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791828.464900:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788791828.465788:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788791828.466095:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788791828.467075:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788791828.467337:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788791828.467381:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788791828.467594:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788791828.467648:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788791828.467686:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788791828.467722:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1788791828.467774:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788791828.467867:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791828.467956:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916d29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791828.469597:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630508160 00000100:00100000:0.0:1788791828.469621:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630508160 00000100:00100000:0.0:1788791828.469988:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788791828.469999:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:20296:x1875683630508160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788791828.470298:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:20296:x1875683630508160:12345-0@lo:502:mount.lustre.0 Request processed in 298us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791828.470307:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788791828.470453:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788791828.470596:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788791828.470611:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788791828.473195:0:20301:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788791828.473209:0:20301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791828.473211:0:20301:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788791828.473219:0:20301:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9abaa0086000 00000020:00000080:2.0:1788791828.473221:0:20301:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788791828.473228:0:20301:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788791828.473230:0:20301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791828.473231:0:20301:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788791828.473234:0:20301:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788791828.473236:0:20301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791828.473237:0:20301:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788791828.473239:0:20301:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9abaa0086000 00000020:00000080:2.0:1788791828.473241:0:20301:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788791828.473300:0:20301:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788791828.473303:0:20301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791828.473305:0:20301:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788791828.473307:0:20301:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788791828.473321:0:20301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791828.473323:0:20301:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788791828.473327:0:20301:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9abaa0086000 00000020:00000080:2.0:1788791828.473329:0:20301:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788791828.473370:0:20301:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788791828.473373:0:20301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791828.473375:0:20301:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788791828.473378:0:20301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:2.0:1788791828.476302:0:20296:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788791828.476341:0:20296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788791828.476367:0:20296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32465e expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.476380:0:20296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32465e expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791828.477321:0:20296:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788791828.477324:0:20296:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9abaa0086000 10000000:01000000:2.0:1788791828.477327:0:20296:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9abaa0086000 10000000:01000000:2.0:1788791828.477332:0:20296:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788791828.477338:0:20296:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9abaa0086000 from 1 10000000:01000000:2.0:1788791828.477340:0:20296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788791828.477377:0:20296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a324665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.477570:0:20296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a324665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.477582:0:20296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a324665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791828.477606:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788791828.477684:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791828.479566:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba917f9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791828.483903:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630508288 00000100:00100000:3.0:1788791828.483919:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630508288 00000100:00100000:3.0:1788791828.483981:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788791828.483992:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:20296:x1875683630508288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791828.484010:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791828.484030:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16c000/0xcd6380150a32466c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a324665 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791828.484057:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16c000/0xcd6380150a32466c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a324665 expref: 19 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791828.484068:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16c000/0xcd6380150a32466c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a324665 expref: 19 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791828.484078:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c000, rc 0) 00000100:00100000:3.0:1788791828.484187:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:20296:x1875683630508288:12345-0@lo:101:mount.lustre.0 Request processed in 196us (6502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791828.484194:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788791828.484258:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791828.484288:0:20296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a324665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32466c expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791828.484296:0:20296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a324665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a32466c expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788791828.485319:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1788791828.486349:0:20296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788791828.486885:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788791828.486934:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788791828.486970:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788791828.487020:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788791828.487057:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788791828.487123:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788791828.487683:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788791828.487720:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788791828.487774:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788791828.487811:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788791828.487859:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788791828.487908:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788791828.487946:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788791828.487980:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788791828.488027:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788791828.488065:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788791828.488098:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788791828.490248:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788791828.490346:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788791828.490383:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788791828.495446:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788791828.495516:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788791828.495551:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788791828.495613:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788791828.495661:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:3.0:1788791828.495695:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:3.0:1788791828.495734:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:3.0:1788791828.495762:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:3.0:1788791828.495789:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:3.0:1788791828.495847:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:3.0:1788791828.495879:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:3.0:1788791828.495904:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:3.0:1788791828.495929:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1788791828.495966:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1788791828.495994:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1788791828.496031:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1788791828.496061:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1788791828.496101:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1788791828.496176:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1788791828.496208:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1788791828.496291:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1788791828.496298:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1788791828.496404:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791828.496470:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791828.496513:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba995af480 going to sleep for 11 seconds 00000100:00100000:3.0:1788791828.496542:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630508416 00000100:00100000:3.0:1788791828.496550:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630508416 00000100:00100000:3.0:1788791828.496604:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788791828.496613:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:20296:x1875683630508416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791828.496806:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d386050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:20296:x1875683630508416:12345-0@lo:501:mount.lustre.0 Request processed in 194us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791828.496814:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788791828.496865:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791828.496904:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788791828.496944:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791828.496965:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba995af480 going to sleep for 11 seconds 00000100:00100000:1.0:1788791828.497305:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630508544 00000100:00100000:1.0:1788791828.497310:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630508544 00000100:00100000:1.0:1788791828.497339:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788791828.497346:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:20296:x1875683630508544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788791828.501871:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:20296:x1875683630508544:12345-0@lo:503:mount.lustre.0 Request processed in 4516us (4917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791828.501886:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788791828.504339:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508544:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788791828.505075:0:20296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788791828.505601:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788791828.505678:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791828.505769:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba995af480 going to sleep for 11 seconds 00000100:00100000:1.0:1788791828.520899:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630508672 00000100:00100000:1.0:1788791828.520914:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630508672 00000100:00100000:1.0:1788791828.520977:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788791828.520987:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:20296:x1875683630508672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791828.521464:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d384850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:20296:x1875683630508672:12345-0@lo:502:mount.lustre.0 Request processed in 476us (15784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791828.521472:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788791828.521543:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788791828.521844:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788791828.521902:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788791828.521960:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788791828.522012:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788791828.522296:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788791828.522354:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788791828.522548:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788791828.522591:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788791828.522641:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788791828.522680:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788791828.522715:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788791828.522762:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788791828.522797:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788791828.522865:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788791828.522918:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788791828.522955:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788791828.522992:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788791828.524928:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788791828.525009:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788791828.525362:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788791828.525430:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788791828.525464:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788791828.525496:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788791828.525545:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788791828.525581:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:1.0:1788791828.525612:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:1.0:1788791828.525657:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:1.0:1788791828.525690:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:1.0:1788791828.525717:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:1.0:1788791828.525786:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:1.0:1788791828.525821:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:1.0:1788791828.525869:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:1.0:1788791828.525901:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:1.0:1788791828.525951:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:1.0:1788791828.525988:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:1.0:1788791828.526038:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:1.0:1788791828.526075:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:1.0:1788791828.526112:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:1.0:1788791828.528531:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:1.0:1788791828.528604:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:1.0:1788791828.528661:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791828.528752:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791828.528798:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916aa840 going to sleep for 11 seconds 00000100:00100000:1.0:1788791828.528824:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630508800 00000100:00100000:1.0:1788791828.528844:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630508800 00000100:00100000:1.0:1788791828.528902:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788791828.528911:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:20296:x1875683630508800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791828.529782:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d385450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:20296:x1875683630508800:12345-0@lo:502:mount.lustre.0 Request processed in 867us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791828.529800:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788791828.529876:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630508800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788791828.529973:0:20296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:1.0:1788791828.529986:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788791828.530935:0:20306:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788791828.530951:0:20306:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9aba88c64d28) 00000020:00000080:1.0:1788791828.530973:0:20306:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788791828.531042:0:20306:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9abaa0086000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788791828.531046:0:20306:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9abaa0086000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788791828.531049:0:20306:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9abaa0086000 3 00010000:00080000:1.0:1788791828.531077:0:20306:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ab981c26800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1788791828.533788:0:20306:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788791828.533999:0:20306:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788791828.534039:0:20306:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788791828.534053:0:20306:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcd6380150a32467a 00000100:00080000:1.0:1788791828.534063:0:20306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788791828.534068:0:20306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ab981c26800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788791828.534104:0:20306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9abab3083b80 x1875683630508928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788791828.534202:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875683630508928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788791828.534281:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788791828.535060:0:20306:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788791828.535146:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788791828.535150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788791828.535152:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ababb9ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788791828.535783:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 602 00000100:00080000:1.0:1788791828.535788:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788791828.535795:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ababb9ae000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788791828.535840:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9abab3081500 x1875683630509184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788791828.535903:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788791828.535921:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630509056:0@lo:400:kworker.0 00000100:00100000:0.0:1788791828.535995:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788791828.537994:0:20306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000100:00100000:2.0:1788791828.538630:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630509184:0@lo:8:kworker.0 00000100:00100000:2.0:1788791828.538713:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791828.538771:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630508928 00000100:00100000:2.0:1788791828.538778:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630508928 00000100:00100000:2.0:1788791828.538819:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788791828.538827:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875683630508928:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788791828.538863:0:18895:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:2.0:1788791828.538899:0:18895:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcd6380150a324681 00000004:00100000:2.0:1788791828.538914:0:18895:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788791828.538946:0:18895:0:(import.c:65:import_set_state_nolock()) ffff9ab982b03800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788791828.539001:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875683630508928:12345-0@lo:38:llog_process_th.0 Request processed in 172us (4719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791828.539009:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788791828.539032:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630509056 00000100:00100000:2.0:1788791828.539036:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630509056 00000100:00100000:2.0:1788791828.539069:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630509184 00000100:00100000:2.0:1788791828.539072:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630509184 00000100:00100000:2.0:1788791828.539086:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791828.539093:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1875683630509056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791828.539192:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1875683630509056:12345-0@lo:400:kworker.0 Request processed in 99us (3196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791828.539199:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791828.539219:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788791828.539223:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875683630509184:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788791828.539260:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875683630509184:12345-0@lo:8:kworker.0 Request processed in 35us (546us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788791828.539266:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788791828.539281:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791828.539319:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630509056:0@lo:400:kworker.0 00000100:00100000:3.0:1788791828.544630:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788791828.544645:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ababb9ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788791828.544652:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788791828.544657:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630509184:0@lo:8:kworker.0 00010000:00080000:3.0:1788791828.544680:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9abab3083b80 x1875683630508928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788791838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791828.544689:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788791828.544697:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788791828.544705:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788791828.544711:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788791828.544714:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ab981c26800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788791828.544719:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875683630508928:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788791828.547974:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791828.547998:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630509312:0@lo:400:kworker.0 00000100:00100000:1.0:1788791828.548075:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788791828.548167:0:20296:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788791828.548209:0:20296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788791828.548225:0:20296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a324665 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32466c expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791828.548236:0:20296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a324665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32466c expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788791828.548293:0:20296:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788791828.548295:0:20296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788791828.548297:0:20296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788791828.548298:0:20296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788791828.548299:0:20296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788791828.548301:0:20296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788791828.548302:0:20296:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788791828.548304:0:20296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788791828.548305:0:20296:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788791828.548309:0:20296:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788791828.548311:0:20296:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788791828.548313:0:20296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788791828.548314:0:20296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788791828.548315:0:20296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788791828.548316:0:20296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788791828.548318:0:20296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788791828.548319:0:20296:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788791828.548320:0:20296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788791828.548321:0:20296:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788791828.548336:0:20296:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788791828.548348:0:20296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630509568:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788791828.548647:0:20296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791828.548683:0:20296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba86039c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788791828.548708:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630509440:0@lo:400:kworker.0 00000100:00100000:1.0:1788791828.548735:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791828.548773:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630509312 00000100:00100000:1.0:1788791828.548779:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630509312 00000100:00100000:1.0:1788791828.548820:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630509440 00000100:00100000:1.0:1788791828.548823:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630509440 00000100:00100000:1.0:1788791828.548863:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788791828.548873:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630509312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791828.548924:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630509312:12345-0@lo:400:kworker.0 Request processed in 54us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791828.548931:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788791828.548949:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788791828.548955:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630509440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791828.548984:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630509440:12345-0@lo:400:kworker.0 Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791828.548990:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788791828.549015:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788791828.549045:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9abab3082d80 x1875683630509312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791828.549058:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630509312:0@lo:400:kworker.0 00010000:00080000:1.0:1788791828.549083:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9abab3083480 x1875683630509440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791828.549090:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630509440:0@lo:400:kworker.0 00000100:00100000:3.0:1788791828.549295:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630509568 00000100:00100000:3.0:1788791828.549300:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630509568 00000100:00100000:3.0:1788791828.549337:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788791828.549344:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:20296:x1875683630509568:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788791828.549374:0:18890:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788791828.549403:0:18890:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788791828.593002:0:18890:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788791828.593537:0:18890:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788791828.597572:0:18911:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788791828.597583:0:18911:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788791828.597610:0:18911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791828.597629:0:18911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ababb92da00/0xcd6380150a324546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a32453f expref: 19 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791828.597637:0:18911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791828.597685:0:18911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ababb92da00/0xcd6380150a324546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a32453f expref: 19 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791828.597700:0:18911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ababb92da00/0xcd6380150a324546 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a32453f expref: 19 pid: 18890 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791828.597714:0:18911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18911:1875683630509696:0@lo:104: 00000100:00100000:1.0:1788791828.597775:0:18911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791828.597819:0:18911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba997df0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791828.597890:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630509696 00000100:00100000:2.0:1788791828.597899:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630509696 00000100:00100000:2.0:1788791828.597953:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788791828.597963:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3082d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:18911:x1875683630509696:12345-0@lo:104: 00010000:00010000:2.0:1788791828.597977:0:18879:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a324546 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.598042:0:18879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788791828.598048:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3082d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:18911:x1875683630509696:12345-0@lo:104: Request processed in 88us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791828.598055:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788791828.598076:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791828.598082:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a324546 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.598089:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cbc00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791828.598093:0:18883:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a324546 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.598101:0:18883:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a324546 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791828.598261:0:18911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18911:1875683630509696:0@lo:104: 00010000:00010000:0.0:1788791828.598282:0:18911:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791828.598715:0:18883:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a324546 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791828.598726:0:18883:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788791828.598767:0:18883:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a324546 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.598774:0:18883:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791828.598803:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a324546 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.598811:0:18883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba851cbc00/0xcd6380150a32453f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a324546 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.598837:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791828.598840:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791828.598842:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791828.598850:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788791828.598863:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3312:1875683630509824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791828.598900:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791828.598939:0:18882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630509824 00000100:00100000:2.0:1788791828.598944:0:18882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630509824 00010000:00010000:2.0:1788791828.598965:0:18882:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ababb92da00/0xcd6380150a324546 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a32453f expref: 20 pid: 18890 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791828.598987:0:18882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788791828.598994:0:18882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+20:3312:x1875683630509824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788791828.599005:0:18882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791828.599020:0:18882:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ababb92da00/0xcd6380150a324546 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a32453f expref: 20 pid: 18890 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.599030:0:18882:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ababb92da00/0xcd6380150a324546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a32453f expref: 20 pid: 18890 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.599043:0:18882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb92da00/0xcd6380150a324546 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a32453f expref: 20 pid: 18890 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.599055:0:18882:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.599062:0:18882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788791828.599075:0:18882:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002094948s 00010000:00010000:2.0:1788791828.599080:0:18882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.599086:0:18882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.599092:0:18882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.599098:0:18882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.599104:0:18882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92c000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791828.599108:0:18882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.599365:0:18882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.599498:0:18882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791828.599512:0:18882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791828.599549:0:18882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3312:x1875683630509824:12345-0@lo:103:ldlm_bl.0 Request processed in 555us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791828.599557:0:18882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788791828.599593:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3312:1875683630509824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791828.599714:0:18911:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791828.599724:0:18911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791828.599730:0:18911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb92c000/0xcd6380150a324688 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791828.615575:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d384c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:20296:x1875683630509568:12345-0@lo:253:mount.lustre.0 Request processed in 66222us (66919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791828.615592:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788791828.615748:0:20296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bac980b1-b5e1-46bc-b749-0bf83764d3cb:20296:1875683630509568:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788791828.615766:0:20296:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788791828.615770:0:20296:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788791828.615772:0:20296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788791828.615774:0:20296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788791828.615775:0:20296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788791828.615776:0:20296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788791828.615778:0:20296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788791828.615779:0:20296:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788791828.615781:0:20296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788791828.615783:0:20296:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788791828.615799:0:20296:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788791828.616924:0:20296:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788791828.617097:0:20296:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788791828.617615:0:20296:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788791828.617774:0:20296:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788791828.617939:0:20296:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788791828.618115:0:20296:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788791828.619612:0:20296:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788791828.695970:0:20296:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788791828.695980:0:20296:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788791828.696015:0:20296:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788791828.696078:0:20296:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788791828.696092:0:20296:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788791828.696730:0:20296:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788791828.774267:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788791829.415969:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788791829.415987:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00010000:00010000:2.0:1788791829.795638:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788791830.308293:0:18892:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788791830.308302:0:18892:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9abab29de000 from 11 10000000:01000000:2.0:1788791830.308308:0:18892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788791830.308358:0:18892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994ff600/0xcd6380150a32468f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791830.308369:0:18892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994ff600/0xcd6380150a32468f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791830.308381:0:18892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994ff600/0xcd6380150a32468f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791830.308407:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb710380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630509952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788791830.308493:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791830.308545:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78da300 going to sleep for 11 seconds 00000100:00100000:3.0:1788791830.308601:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630509952 00000100:00100000:3.0:1788791830.308609:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630509952 00000100:00100000:3.0:1788791830.308662:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788791830.308670:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:18892:x1875683630509952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791830.308682:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791830.308696:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16dc00/0xcd6380150a324696 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a32468f expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791830.308717:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16dc00/0xcd6380150a324696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a32468f expref: 19 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791830.308727:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16dc00/0xcd6380150a324696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a32468f expref: 19 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791830.308736:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16dc00, rc 0) 00000100:00100000:3.0:1788791830.308775:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:18892:x1875683630509952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791830.308782:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788791830.308878:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb710380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630509952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791830.308893:0:18892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994ff600/0xcd6380150a32468f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324696 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791830.308901:0:18892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994ff600/0xcd6380150a32468f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a324696 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791830.308949:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb710380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630510080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788791830.308981:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791830.309014:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78da300 going to sleep for 11 seconds 00000100:00100000:3.0:1788791830.309053:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630510080 00000100:00100000:3.0:1788791830.309057:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630510080 00000100:00100000:3.0:1788791830.309086:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788791830.309092:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:18892:x1875683630510080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788791830.309106:0:18890:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788791830.309151:0:18890:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788791830.309155:0:18890:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788791830.309226:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:18892:x1875683630510080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791830.309237:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788791830.309329:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb710380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630510080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788791830.309385:0:18892:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788791830.309392:0:18892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994ff600/0xcd6380150a32468f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324696 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791830.309399:0:18892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994ff600/0xcd6380150a32468f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324696 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791830.819494:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791831.347381:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788791831.347412:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630510208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791831.347499:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791831.348228:0:19584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630510208 00000100:00100000:2.0:1788791831.348239:0:19584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630510208 00000100:00080000:0.0:1788791831.348332:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791831.348341:0:19584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788791831.348352:0:19584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630510208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788791831.348387:0:19584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788791831.349314:0:19584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630510208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 961us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791831.349340:0:19584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788791831.349356:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788791831.349381:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630510208:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788791831.845273:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791832.870616:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788791833.189045:0:18928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788791833.891632:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788791833.894696:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788791833.894703:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788791833.894707:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ababb9ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788791833.894724:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ababb9ae000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788791833.894769:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9abab3080a80 x1875683630510592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788791833.894827:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630510720:0@lo:400:kworker.0 00000100:00100000:1.0:1788791833.894894:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791833.894952:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788791833.894958:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630510464:0@lo:400:kworker.0 00000100:00100000:1.0:1788791833.894985:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791833.895021:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630510720 00000100:00100000:1.0:1788791833.895028:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630510720 00000100:00100000:0.0:1788791833.895488:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3315:1875683630510336:0@lo:400:kworker.0 00000100:00100000:0.0:1788791833.895527:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791833.895553:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630510976:0@lo:400:kworker.0 00000100:00100000:0.0:1788791833.895580:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791833.895603:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788791833.895608:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630510848:0@lo:400:kworker.0 00000100:00100000:0.0:1788791833.895631:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791833.895678:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630510336 00000100:00100000:0.0:1788791833.895682:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630510336 00000100:00100000:0.0:1788791833.895715:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788791833.895724:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3315:x1875683630510336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791833.895812:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3315:x1875683630510336:12345-0@lo:400:kworker.0 Request processed in 88us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791833.895819:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788791833.895848:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630510976 00000100:00100000:0.0:1788791833.895851:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630510976 00000100:00100000:0.0:1788791833.895882:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630510848 00000100:00100000:0.0:1788791833.895885:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630510848 00000100:00100000:0.0:1788791833.895901:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788791833.895907:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630510976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791833.895937:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630510976:12345-0@lo:400:kworker.0 Request processed in 30us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791833.895956:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788791833.895969:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788791833.895975:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630510848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791833.896004:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630510848:12345-0@lo:400:kworker.0 Request processed in 30us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791833.896010:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788791833.896570:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788791833.896580:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630510720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791833.896625:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630510720:12345-0@lo:400:kworker.0 Request processed in 47us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791833.896632:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788791833.896669:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab3083800 x1875683630510720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791833.896683:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630510720:0@lo:400:kworker.0 00000100:00100000:2.0:1788791833.896875:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630510464 00000100:00100000:2.0:1788791833.896881:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630510464 00000100:00100000:2.0:1788791833.896917:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788791833.896924:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630510464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791833.896965:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630510464:12345-0@lo:400:kworker.0 Request processed in 42us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791833.896971:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788791833.897002:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630510464:0@lo:400:kworker.0 00000100:00100000:3.0:1788791833.897321:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630510592:0@lo:8:kworker.0 00000100:00100000:3.0:1788791833.897358:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791833.897392:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630510592 00000100:00100000:3.0:1788791833.897396:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630510592 00000100:00100000:3.0:1788791833.897416:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788791833.897421:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875683630510592:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788791833.897445:0:19580:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 610 last 0 00000020:00000080:3.0:1788791833.897486:0:19580:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a32469d 00002000:00100000:3.0:1788791833.897501:0:19580:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9abab706a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788791833.897505:0:19580:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788791833.897508:0:19580:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788791833.898438:0:19580:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788791833.898466:0:19580:0:(import.c:65:import_set_state_nolock()) ffff9abab706f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791833.898534:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875683630510592:12345-0@lo:8:kworker.0 Request processed in 1110us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791833.898542:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788791833.898585:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab3080a80 x1875683630510592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788791858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788791833.898599:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788791833.898606:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788791833.898611:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788791833.898613:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ababb9ae000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788791833.898629:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788791833.898647:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630510592:0@lo:8:kworker.0 00000004:00080000:3.0:1788791833.898699:0:18920:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788791833.898716:0:18920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18920:1875683630511232:0@lo:5:osp-pre-1-0.0 00010000:00080000:0.0:1788791833.900016:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab3081880 x1875683630510848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791833.900032:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630510848:0@lo:400:kworker.0 00000100:00100000:0.0:1788791833.900045:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3315:1875683630510336:0@lo:400:kworker.0 00010000:00080000:0.0:1788791833.900056:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab3082680 x1875683630510976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791833.900064:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630510976:0@lo:400:kworker.0 00000100:00080000:0.0:1788791833.901365:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788791833.901373:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788791833.901473:0:18919:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788791833.901880:0:18919:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 610281752479ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788791833.902356:0:18920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791833.902400:0:18920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788791833.902424:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630511104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791833.902488:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791833.902533:0:19584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630511104 00000100:00100000:3.0:1788791833.902542:0:19584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630511104 00000100:00100000:3.0:1788791833.902597:0:19584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788791833.902607:0:19584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875683630511104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788791833.902639:0:19584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791833.902684:0:19584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875683630511104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791833.902689:0:19584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788791833.902727:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb6d1880 x1875683630511104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791833.904266:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630511104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791833.904632:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630511232 00000100:00100000:0.0:1788791833.904642:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630511232 00000100:00100000:0.0:1788791833.904690:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788791833.904700:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18920:x1875683630511232:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1788791833.906337:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1788791833.918115:0:19582:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788791833.918153:0:19582:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1788791833.918158:0:19582:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:65) 00002000:00010000:0.0:1788791833.947640:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.947654:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.947671:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.947675:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.947681:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.947699:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.947709:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.947717:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.947750:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791833.947764:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.947769:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.947778:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.947783:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.947808:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.947826:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.947834:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.947856:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.947859:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.947861:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.948754:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.948763:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.948775:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.948779:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.948783:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.948793:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.948802:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.948816:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.948836:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791833.948847:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.948851:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.948858:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cb200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.948862:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.948869:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.948882:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.948888:0:18883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.948906:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.948908:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.948910:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.949788:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.949806:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a3246b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.949818:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.949822:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.949827:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a3246b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.949839:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a3246b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.949848:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a3246b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.949856:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a3246b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.949925:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788791833.950379:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.950386:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.950396:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.950399:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.950403:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.950413:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.950429:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.950436:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791833.953314:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788791833.953326:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a3246b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791833.953340:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cb400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791833.953345:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a3246b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791833.953355:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a3246b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791833.953377:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a3246b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791833.953385:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a3246b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791833.953420:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791833.953424:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791833.953430:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cbc00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791833.953434:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791833.953441:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791833.953450:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791833.953457:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791833.953459:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791833.953461:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.955304:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788791833.955318:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791833.955707:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.956191:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.956200:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956214:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.956220:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.956226:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956242:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956253:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956274:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956293:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791833.956304:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.956309:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956318:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851caa00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.956323:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956332:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956349:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956356:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956372:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.956374:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.956376:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.956861:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.956874:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956885:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.956889:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.956893:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956902:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956910:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956918:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.956933:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788791833.960938:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.960951:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.960969:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.960975:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.960981:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.960996:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.961014:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.961023:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.962712:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788791833.962745:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788791833.962761:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.962773:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.962778:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.962788:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.962808:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.962816:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.962836:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.962849:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.962857:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cba00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.962860:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.962867:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.962878:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.962885:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.962899:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.962900:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.962902:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791833.966343:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.967590:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.967604:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a3246d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.967622:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.967627:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.967633:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a3246d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.967666:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a3246d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.967678:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a3246d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.967686:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a3246d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.967705:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791833.967719:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.967725:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a3246d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.967733:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.968293:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a3246d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.968306:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a3246d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.968325:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a3246d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.968345:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a3246d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.968371:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.968373:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.968375:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.968974:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.968981:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.968991:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.968995:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.969001:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969011:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969019:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969027:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969043:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788791833.969447:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.969454:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969492:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.969496:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.969500:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969511:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969519:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969526:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969540:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788791833.969551:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788791833.969556:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969563:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851caa00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.969568:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969577:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969601:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969607:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f79afe21/0xcd6380150a3246dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969622:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.969625:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969632:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cbc00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.969636:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969643:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969653:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969660:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015a4f3d6/0xcd6380150a3246e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.969672:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.969674:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.969681:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.970097:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.970103:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970113:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.970117:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.970122:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970152:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970161:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970168:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970181:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791833.970189:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.970193:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970200:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cb200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.970204:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970224:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970235:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970242:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a3246ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970256:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.970258:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.970260:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.970645:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.970651:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970659:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.970662:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.970666:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970675:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970683:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970696:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970710:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791833.970719:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.970723:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970729:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.970733:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970754:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970766:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970773:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a3246f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.970786:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.970788:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.970790:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791833.973374:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.977958:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.977982:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.978000:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.978005:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.978012:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.978028:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.978038:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.978047:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.978069:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791833.982173:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.982193:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.982209:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cba00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.982215:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.982228:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.982268:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.982277:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3015e7e/0xcd6380150a3246f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.982306:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.982308:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.982310:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.984561:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.984576:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.984593:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.984598:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.984605:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.984620:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.984631:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.984639:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.984668:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788791833.985898:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.985908:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a324706 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.985921:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.985925:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.985930:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a324706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.985941:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a324706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.985950:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a324706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.985958:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a324706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.985976:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788791833.985987:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788791833.985993:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.986001:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.986012:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.986021:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791833.986152:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.987708:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.987726:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d99a898/0xcd6380150a3246ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.987761:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.987764:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.987766:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.988419:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.988427:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a32470d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.988440:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.988444:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.988449:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a32470d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.988461:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a32470d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.988470:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a32470d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.988485:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a32470d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.988508:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791833.988519:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.988524:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a32470d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.988531:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.988536:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a32470d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.988545:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a32470d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.988558:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a32470d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.988565:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000150688d4/0xcd6380150a32470d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.988580:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.988582:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.988584:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.989014:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.989027:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c05d729a/0xcd6380150a324714 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989036:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.989041:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.989046:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c05d729a/0xcd6380150a324714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989055:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c05d729a/0xcd6380150a324714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989064:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c05d729a/0xcd6380150a324714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989072:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c05d729a/0xcd6380150a324714 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989087:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791833.989096:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.989100:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c05d729a/0xcd6380150a324714 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989108:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8d400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.989112:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c05d729a/0xcd6380150a324714 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989120:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c05d729a/0xcd6380150a324714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989163:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c05d729a/0xcd6380150a324714 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989171:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c05d729a/0xcd6380150a324714 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989186:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.989188:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.989191:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.989619:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.989627:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2845d6/0xcd6380150a32471b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989637:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.989640:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.989644:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d2845d6/0xcd6380150a32471b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989654:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d2845d6/0xcd6380150a32471b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989662:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d2845d6/0xcd6380150a32471b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989670:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d2845d6/0xcd6380150a32471b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989695:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791833.989705:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.989709:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d2845d6/0xcd6380150a32471b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989716:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8d000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.989720:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2845d6/0xcd6380150a32471b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989729:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d2845d6/0xcd6380150a32471b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989756:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d2845d6/0xcd6380150a32471b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989765:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d2845d6/0xcd6380150a32471b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.989781:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.989783:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.989785:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791833.990183:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791833.990190:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023285f4c/0xcd6380150a324722 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.990200:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791833.990208:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791833.990213:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023285f4c/0xcd6380150a324722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.990223:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023285f4c/0xcd6380150a324722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.990233:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023285f4c/0xcd6380150a324722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.990240:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023285f4c/0xcd6380150a324722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.990254:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791833.990263:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791833.990267:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023285f4c/0xcd6380150a324722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.990273:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8de00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791833.990277:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023285f4c/0xcd6380150a324722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.990285:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023285f4c/0xcd6380150a324722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.990295:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023285f4c/0xcd6380150a324722 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.990314:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023285f4c/0xcd6380150a324722 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791833.990331:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.990333:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791833.990334:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791833.994414:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791833.994428:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a324706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791833.994443:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cb400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791833.994447:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a324706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791833.994458:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a324706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791833.994484:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a324706 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791833.994491:0:18883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4cda335/0xcd6380150a324706 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791833.994530:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791833.994532:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791833.994534:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791833.994540:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791833.994541:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788791833.998334:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788791834.001849:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791834.001865:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008429d5a3/0xcd6380150a324729 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.001883:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791834.001887:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791834.001894:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008429d5a3/0xcd6380150a324729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.001909:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008429d5a3/0xcd6380150a324729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.001920:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008429d5a3/0xcd6380150a324729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.001928:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008429d5a3/0xcd6380150a324729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.001948:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791834.001961:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791834.001980:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008429d5a3/0xcd6380150a324729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.001988:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8ca00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791834.001992:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008429d5a3/0xcd6380150a324729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.002001:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008429d5a3/0xcd6380150a324729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.002020:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008429d5a3/0xcd6380150a324729 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.002028:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008429d5a3/0xcd6380150a324729 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.002045:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791834.002047:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791834.002049:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791834.007925:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791834.007938:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016405755/0xcd6380150a324730 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.007954:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791834.007958:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791834.007965:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016405755/0xcd6380150a324730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.007993:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016405755/0xcd6380150a324730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.008003:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016405755/0xcd6380150a324730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.008010:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016405755/0xcd6380150a324730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.010284:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788791834.028551:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791834.028566:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c07345b7/0xcd6380150a324737 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.028583:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=610s v=(0 0) 00010000:00010000:0.0:1788791834.028588:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791834.028594:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c07345b7/0xcd6380150a324737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.028609:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c07345b7/0xcd6380150a324737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.028619:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c07345b7/0xcd6380150a324737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.028649:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c07345b7/0xcd6380150a324737 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791834.029484:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788791834.029494:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016405755/0xcd6380150a324730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791834.029506:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8dc00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791834.029511:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016405755/0xcd6380150a324730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791834.029537:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016405755/0xcd6380150a324730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791834.029558:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016405755/0xcd6380150a324730 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791834.029566:0:18883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016405755/0xcd6380150a324730 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.029762:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791834.029770:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c07345b7/0xcd6380150a324737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.029779:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8ce00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791834.029783:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c07345b7/0xcd6380150a324737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.029792:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c07345b7/0xcd6380150a324737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.029804:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c07345b7/0xcd6380150a324737 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.029812:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791834.029813:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791834.029815:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791834.036340:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788791834.036354:0:19582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c07345b7/0xcd6380150a324737 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788791834.037149:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791834.037173:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd8a22ca/0xcd6380150a32473e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.037188:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=610s v=(0 0) 00010000:00010000:1.0:1788791834.037199:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791834.037206:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd8a22ca/0xcd6380150a32473e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.037222:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd8a22ca/0xcd6380150a32473e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.037234:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd8a22ca/0xcd6380150a32473e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.037241:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd8a22ca/0xcd6380150a32473e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.037255:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788791834.037906:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791834.037914:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004f607bc/0xcd6380150a324745 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.037925:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=610s v=(0 0) 00010000:00010000:1.0:1788791834.037928:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791834.037933:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004f607bc/0xcd6380150a324745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.037943:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004f607bc/0xcd6380150a324745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.037951:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004f607bc/0xcd6380150a324745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.037964:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004f607bc/0xcd6380150a324745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.038039:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788791834.038149:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788791834.038159:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd8a22ca/0xcd6380150a32473e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.038169:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92d600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791834.038174:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd8a22ca/0xcd6380150a32473e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.038184:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd8a22ca/0xcd6380150a32473e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.038202:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd8a22ca/0xcd6380150a32473e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.038209:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd8a22ca/0xcd6380150a32473e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.038230:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791834.038241:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004f607bc/0xcd6380150a324745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.038265:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92ca00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791834.038269:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004f607bc/0xcd6380150a324745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.038277:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004f607bc/0xcd6380150a324745 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.038287:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004f607bc/0xcd6380150a324745 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.038294:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004f607bc/0xcd6380150a324745 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.038310:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791834.038313:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791834.038315:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791834.038657:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791834.038663:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faa2a675/0xcd6380150a32474c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.038674:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=610s v=(0 0) 00010000:00010000:1.0:1788791834.038678:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791834.038683:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faa2a675/0xcd6380150a32474c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.038693:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faa2a675/0xcd6380150a32474c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.038702:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faa2a675/0xcd6380150a32474c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.038710:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faa2a675/0xcd6380150a32474c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.038748:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788791834.039569:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791834.039576:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d64f9bf/0xcd6380150a324753 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.039593:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=610s v=(0 0) 00010000:00010000:1.0:1788791834.039597:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791834.039601:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d64f9bf/0xcd6380150a324753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.039612:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d64f9bf/0xcd6380150a324753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.039621:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d64f9bf/0xcd6380150a324753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.039629:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d64f9bf/0xcd6380150a324753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.039639:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788791834.040181:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788791834.040189:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faa2a675/0xcd6380150a32474c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.040197:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92d000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791834.040202:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faa2a675/0xcd6380150a32474c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.040223:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faa2a675/0xcd6380150a32474c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.040239:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faa2a675/0xcd6380150a32474c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.040247:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faa2a675/0xcd6380150a32474c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.040265:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791834.040269:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d64f9bf/0xcd6380150a324753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.040276:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92cc00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791834.040279:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d64f9bf/0xcd6380150a324753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.040287:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d64f9bf/0xcd6380150a324753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.040297:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d64f9bf/0xcd6380150a324753 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.040304:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d64f9bf/0xcd6380150a324753 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.040343:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791834.040345:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791834.040347:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791834.040950:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791834.040959:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005795bc5c/0xcd6380150a32475a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.040971:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=610s v=(0 0) 00010000:00010000:1.0:1788791834.040975:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791834.040980:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005795bc5c/0xcd6380150a32475a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.040991:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005795bc5c/0xcd6380150a32475a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.041013:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005795bc5c/0xcd6380150a32475a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.041021:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005795bc5c/0xcd6380150a32475a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.041056:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788791834.041828:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791834.041835:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007175a38/0xcd6380150a324761 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.041848:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=610s v=(0 0) 00010000:00010000:1.0:1788791834.041851:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791834.041856:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007175a38/0xcd6380150a324761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.041865:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007175a38/0xcd6380150a324761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.041873:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007175a38/0xcd6380150a324761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.041880:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007175a38/0xcd6380150a324761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.041899:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788791834.042195:0:20559:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788791834.042203:0:20559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005795bc5c/0xcd6380150a32475a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.042223:0:20559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92c200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791834.042228:0:20559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005795bc5c/0xcd6380150a32475a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.042237:0:20559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005795bc5c/0xcd6380150a32475a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.042253:0:20559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005795bc5c/0xcd6380150a32475a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.042261:0:20559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005795bc5c/0xcd6380150a32475a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.042281:0:20559:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791834.042284:0:20559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007175a38/0xcd6380150a324761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.042291:0:20559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92c400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791834.042294:0:20559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007175a38/0xcd6380150a324761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.042302:0:20559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007175a38/0xcd6380150a324761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.042312:0:20559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007175a38/0xcd6380150a324761 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.042339:0:20559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007175a38/0xcd6380150a324761 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.042354:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791834.042356:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791834.042358:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791834.042364:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791834.042958:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791834.042965:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c88099/0xcd6380150a324768 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.042975:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=610s v=(0 0) 00010000:00010000:1.0:1788791834.042978:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791834.042983:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071c88099/0xcd6380150a324768 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.042993:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071c88099/0xcd6380150a324768 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.043001:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071c88099/0xcd6380150a324768 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.043009:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071c88099/0xcd6380150a324768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.043034:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791834.043179:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791834.043186:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071c88099/0xcd6380150a324768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.043194:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92c000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791834.043198:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c88099/0xcd6380150a324768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.043206:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071c88099/0xcd6380150a324768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.043219:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071c88099/0xcd6380150a324768 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.043227:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071c88099/0xcd6380150a324768 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791834.043242:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791834.043244:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791834.043246:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791834.044168:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788791834.049917:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788791834.049931:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eae2a9fc/0xcd6380150a32476f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.049949:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=610s v=(0 0) 00010000:00010000:2.0:1788791834.049955:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791834.049961:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eae2a9fc/0xcd6380150a32476f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.049975:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eae2a9fc/0xcd6380150a32476f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.049985:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eae2a9fc/0xcd6380150a32476f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.049993:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eae2a9fc/0xcd6380150a32476f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.050025:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788791834.050549:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791834.050558:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eae2a9fc/0xcd6380150a32476f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.050567:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791834.050578:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eae2a9fc/0xcd6380150a32476f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.050588:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eae2a9fc/0xcd6380150a32476f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.050606:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eae2a9fc/0xcd6380150a32476f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.050614:0:18883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eae2a9fc/0xcd6380150a32476f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.050630:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791834.050632:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791834.050634:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788791834.050906:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788791834.050912:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000948f91f5/0xcd6380150a324776 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.050923:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=610s v=(0 0) 00010000:00010000:2.0:1788791834.050926:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791834.050931:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948f91f5/0xcd6380150a324776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.050940:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000948f91f5/0xcd6380150a324776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.050948:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000948f91f5/0xcd6380150a324776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.050956:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000948f91f5/0xcd6380150a324776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.050979:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788791834.051424:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791834.051430:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000948f91f5/0xcd6380150a324776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.051438:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffc00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791834.051442:0:18884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000948f91f5/0xcd6380150a324776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.051451:0:18884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000948f91f5/0xcd6380150a324776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.051464:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000948f91f5/0xcd6380150a324776 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.051479:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000948f91f5/0xcd6380150a324776 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791834.051495:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791834.051498:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791834.051500:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788791834.051821:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788791834.051828:0:19582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094928b14/0xcd6380150a32477d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.051839:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=610s v=(0 0) 00010000:00010000:2.0:1788791834.051849:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791834.051854:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094928b14/0xcd6380150a32477d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.051865:0:19582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094928b14/0xcd6380150a32477d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.051873:0:19582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094928b14/0xcd6380150a32477d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.051881:0:19582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094928b14/0xcd6380150a32477d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.051895:0:19582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791834.051903:0:20559:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791834.051908:0:20559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094928b14/0xcd6380150a32477d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.051915:0:20559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffa00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791834.051918:0:20559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094928b14/0xcd6380150a32477d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.051926:0:20559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094928b14/0xcd6380150a32477d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.051937:0:20559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094928b14/0xcd6380150a32477d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.051956:0:20559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094928b14/0xcd6380150a32477d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791834.051971:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791834.051974:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791834.051976:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788791834.055518:0:19582:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1788791834.055625:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18920:x1875683630511232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 150921us (153265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791834.055638:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788791834.055943:0:18920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18920:1875683630511232:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788791834.055959:0:18920:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788791834.056005:0:18920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18920:1875683630511360:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788791834.056550:0:18920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791834.056601:0:18920:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788791834.057456:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630511360 00000100:00100000:2.0:1788791834.057465:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630511360 00000100:00100000:2.0:1788791834.057521:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788791834.057531:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18920:x1875683630511360:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788791834.057578:0:19580:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1788791834.073635:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:18920:x1875683630511360:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16095us (17075us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788791834.073648:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788791834.074031:0:18920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18920:1875683630511360:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788791834.074058:0:18920:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:1.0:1788791834.918437:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791835.940332:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788791836.045769:0:20654:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788791836.452515:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630511488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791836.452585:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791836.452686:0:19584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630511488 00000100:00100000:0.0:1788791836.452706:0:19584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630511488 00000100:00100000:0.0:1788791836.452762:0:19584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791836.452772:0:19584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630511488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791836.452806:0:19584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788791836.452854:0:19584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630511488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791836.452861:0:19584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791836.452909:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630511488:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788791836.455901:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788791836.964538:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791837.994098:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791838.768444:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791838.769433:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606399232 00000100:00100000:3.0:1788791838.769445:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606399232 00000100:00100000:3.0:1788791838.769499:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:3.0:1788791838.769516:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1875683606399232:12345-192.168.201.29@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788791838.769543:0:18888:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 083ef4df-491f-4201-9752-09108931e701@192.168.201.29@tcp t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:3.0:1788791838.769572:0:18888:0:(genops.c:1385:class_connect()) connect: client 083ef4df-491f-4201-9752-09108931e701, cookie 0xcd6380150a324784 00000100:00080000:3.0:1788791838.769725:0:18888:0:(import.c:65:import_set_state_nolock()) ffff9abab7068000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791838.769806:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+5:2351:x1875683606399232:12345-192.168.201.29@tcp:250:mount.lustre.0 Request processed in 290us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791838.769831:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:1.0:1788791838.774912:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791838.775044:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606399360 00000100:00100000:0.0:1788791838.775055:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606399360 00000100:00100000:0.0:1788791838.775262:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:0.0:1788791838.775274:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+5:16747:x1875683606399360:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788791838.775291:0:18890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791838.775310:0:18890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ab981c8da00/0xcd6380150a32478b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a94536754d8 expref: -99 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791838.775349:0:18890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ab981c8da00/0xcd6380150a32478b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754d8 expref: 6 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791838.775359:0:18890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ab981c8da00/0xcd6380150a32478b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754d8 expref: 6 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791838.775368:0:18890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ab981c8da00, rc 0) 00000100:00100000:0.0:1788791838.775430:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+6:16747:x1875683606399360:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 158us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791838.775437:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:1.0:1788791838.788538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791838.788747:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606399488 00000100:00100000:0.0:1788791838.788757:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606399488 00000100:00100000:0.0:1788791838.788818:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:0.0:1788791838.788829:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+6:16747:x1875683606399488:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788791838.789454:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d385c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+6:16747:x1875683606399488:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 624us (922us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788791838.789468:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:2.0:1788791838.799579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791838.799691:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606399616 00000100:00100000:0.0:1788791838.799702:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606399616 00000100:00100000:0.0:1788791838.799764:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:0.0:1788791838.799773:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+6:16747:x1875683606399616:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788791838.799790:0:18890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791838.799808:0:18890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ab981c8c800/0xcd6380150a324792 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a94536754df expref: -99 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791838.799838:0:18890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ab981c8c800/0xcd6380150a324792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754df expref: 7 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791838.799848:0:18890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ab981c8c800/0xcd6380150a324792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754df expref: 7 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791838.799857:0:18890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ab981c8c800, rc 0) 00000100:00100000:0.0:1788791838.799921:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d386450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+7:16747:x1875683606399616:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 149us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791838.799928:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:1.0:1788791838.805526:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791838.805803:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606399744 00000100:00100000:2.0:1788791838.805814:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606399744 00000100:00100000:2.0:1788791838.805873:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:2.0:1788791838.805883:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+7:16747:x1875683606399744:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788791838.806255:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d384450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+8:16747:x1875683606399744:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 372us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791838.806263:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:1.0:1788791838.820083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791838.820251:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606399872 00000100:00100000:2.0:1788791838.820265:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606399872 00000100:00100000:2.0:1788791838.820436:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:2.0:1788791838.820448:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+8:16747:x1875683606399872:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788791838.820693:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+8:16747:x1875683606399872:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 246us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791838.820702:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:0.0:1788791838.824994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791838.825489:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606400000 00000100:00100000:3.0:1788791838.825512:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606400000 00000100:00100000:3.0:1788791838.825571:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:3.0:1788791838.825582:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8d385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+8:16766:x1875683606400000:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788791838.825984:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8d385050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+8:16766:x1875683606400000:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 400us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791838.825993:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:1.0:1788791838.871194:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791838.871716:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606400128 00000100:00100000:3.0:1788791838.871727:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606400128 00000100:00100000:3.0:1788791838.871786:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1788791838.871797:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+8:16766:x1875683606400128:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788791838.872080:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+8:16766:x1875683606400128:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 284us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791838.872089:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:1.0:1788791838.883657:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791838.883767:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606400256 00000100:00100000:2.0:1788791838.883776:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606400256 00000100:00100000:2.0:1788791838.883833:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:2.0:1788791838.883844:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+8:16747:x1875683606400256:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788791838.883860:0:18889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791838.883878:0:18889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ff400/0xcd6380150a324799 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453675509 expref: -99 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791838.883906:0:18889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff400/0xcd6380150a324799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675509 expref: 9 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791838.883917:0:18889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ff400/0xcd6380150a324799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675509 expref: 9 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791838.883926:0:18889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff400, rc 0) 00000100:00100000:2.0:1788791838.883996:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+9:16747:x1875683606400256:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 147us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791838.884017:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:1.0:1788791838.898577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791838.908710:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606400384 00000100:00100000:0.0:1788791838.908757:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606400384 00000100:00100000:0.0:1788791838.908831:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:0.0:1788791838.908841:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+9:16747:x1875683606400384:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788791838.908880:0:18890:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788791838.908898:0:18890:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788791838.908903:0:18890:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788791838.908906:0:18890:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788791838.908909:0:18890:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1788791838.920463:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+9:16747:x1875683606400384:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 11613us (21888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791838.920474:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:1.0:1788791838.945736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791838.945828:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606400512 00000100:00100000:3.0:1788791838.945839:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606400512 00000100:00100000:3.0:1788791838.945917:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:3.0:1788791838.945929:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+9:16747:x1875683606400512:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788791838.945949:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791838.945980:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16d000/0xcd6380150a3247a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453675510 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791838.946014:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16d000/0xcd6380150a3247a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675510 expref: 10 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791838.946044:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16d000/0xcd6380150a3247a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675510 expref: 10 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791838.946053:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d000, rc 0) 00000100:00100000:3.0:1788791838.946179:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+10:16747:x1875683606400512:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 251us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791838.946186:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:1.0:1788791838.952589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791838.953168:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606400640 00000100:00100000:0.0:1788791838.953181:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606400640 00000100:00100000:0.0:1788791838.953254:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:0.0:1788791838.953266:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+10:16747:x1875683606400640:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788791838.953566:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+10:16747:x1875683606400640:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 301us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791838.953576:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:1.0:1788791838.966229:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791838.966668:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606400768 00000100:00100000:2.0:1788791838.966680:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606400768 00000100:00100000:2.0:1788791838.966928:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:2.0:1788791838.966940:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+10:16747:x1875683606400768:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788791838.967683:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+10:16747:x1875683606400768:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 741us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791838.967693:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:3.0:1788791838.992450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791838.993746:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606400896 00000100:00100000:1.0:1788791838.993759:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606400896 00000100:00100000:1.0:1788791838.994413:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:1.0:1788791838.994427:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+10:16772:x1875683606400896:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788791838.995609:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+10:16772:x1875683606400896:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 290us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791838.995622:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 88 00010000:00010000:3.0:1788791839.012013:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791839.012299:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630511616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791839.012374:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791839.012448:0:19584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630511616 00000100:00100000:0.0:1788791839.012456:0:19584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630511616 00000100:00100000:0.0:1788791839.012510:0:19584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788791839.012521:0:19584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875683630511616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791839.012556:0:19584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791839.012600:0:19584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875683630511616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791839.012618:0:19584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788791839.012679:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630511616:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788791839.015203:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788791839.015336:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630511872:0@lo:400:kworker.0 00000100:00100000:1.0:1788791839.015402:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791839.015437:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791839.015444:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630512000:0@lo:400:kworker.0 00000100:00100000:1.0:1788791839.015470:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791839.015514:0:19583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630511872 00000100:00100000:1.0:1788791839.015521:0:19583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630511872 00000100:00100000:1.0:1788791839.015571:0:19583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788791839.015582:0:19583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630511872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791839.015627:0:19583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630511872:12345-0@lo:400:kworker.0 Request processed in 48us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791839.015634:0:19583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788791839.015670:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630512000 00000100:00100000:1.0:1788791839.015674:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630512000 00000100:00100000:1.0:1788791839.015699:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788791839.015706:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630512000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791839.015735:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630512000:12345-0@lo:400:kworker.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791839.015741:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788791839.015758:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788791839.015779:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb912300 x1875683630512000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791839.015807:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630512000:0@lo:400:kworker.0 00000100:00100000:1.0:1788791839.015818:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630511872:0@lo:400:kworker.0 00000100:00100000:1.0:1788791839.015839:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630512128:0@lo:400:kworker.0 00000100:00100000:1.0:1788791839.015860:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791839.015878:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788791839.015883:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3314:1875683630511744:0@lo:400:kworker.0 00000100:00100000:1.0:1788791839.015906:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791839.015927:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630512256:0@lo:400:kworker.0 00000100:00100000:1.0:1788791839.015946:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791839.015968:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630512128 00000100:00100000:1.0:1788791839.015971:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630512128 00000100:00100000:1.0:1788791839.016009:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630512256 00000100:00100000:1.0:1788791839.016012:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630512256 00000100:00100000:1.0:1788791839.016030:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788791839.016036:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630512128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791839.016068:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630512128:12345-0@lo:400:kworker.0 Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791839.016074:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788791839.016086:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788791839.016091:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630512256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791839.016116:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630512256:12345-0@lo:400:kworker.0 Request processed in 25us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791839.016122:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788791839.016163:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788791839.016186:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb910000 x1875683630512256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791839.016195:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630512256:0@lo:400:kworker.0 00010000:00080000:1.0:1788791839.016202:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb910380 x1875683630512128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791839.016209:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630512128:0@lo:400:kworker.0 00000100:00100000:1.0:1788791839.016256:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791839.018089:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630511744 00000100:00100000:2.0:1788791839.018102:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630511744 00000100:00100000:2.0:1788791839.018176:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606401024 00000100:00100000:2.0:1788791839.018180:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606401024 00000100:00100000:2.0:1788791839.018199:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788791839.018208:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3314:x1875683630511744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791839.018299:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3314:x1875683630511744:12345-0@lo:400:kworker.0 Request processed in 92us (2391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791839.018307:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788791839.018337:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:2.0:1788791839.018343:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+10:16772:x1875683606401024:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788791839.018562:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+10:16772:x1875683606401024:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 217us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791839.018569:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:1.0:1788791839.023379:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3314:1875683630511744:0@lo:400:kworker.0 00000100:00100000:2.0:1788791839.034337:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791839.035082:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606401152 00000100:00100000:2.0:1788791839.035091:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606401152 00000100:00100000:2.0:1788791839.035155:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1788791839.035161:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1875683606401152:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788791839.035185:0:18897:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35fd46c2-6db5-48a7-8c88-eca01b9f5ee2@192.168.201.29@tcp t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:2.0:1788791839.035219:0:18897:0:(genops.c:1385:class_connect()) connect: client 35fd46c2-6db5-48a7-8c88-eca01b9f5ee2, cookie 0xcd6380150a3247a7 00000004:00100000:2.0:1788791839.035243:0:18897:0:(mdt_handler.c:7331:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788791839.035247:0:18897:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1788791839.110478:0:18897:0:(import.c:65:import_set_state_nolock()) ffff9abab706b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791839.110562:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2351:x1875683606401152:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 75398us (76229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791839.110578:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1788791839.132295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791839.132321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791839.132348:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606401280 00000100:00100000:3.0:1788791839.132357:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606401280 00000100:00100000:1.0:1788791839.132374:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606401408 00000100:00100000:1.0:1788791839.132381:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606401408 00000100:00100000:3.0:1788791839.132420:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788791839.132432:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:0:x1875683606401280:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788791839.132474:0:18895:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788791839.132566:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:0:x1875683606401280:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 136us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791839.132575:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788791839.132593:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788791839.132600:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:16747:x1875683606401408:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788791839.132621:0:18895:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788791839.132657:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:16747:x1875683606401408:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 46us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791839.132664:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00080000:3.0:1788791839.139026:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791839.139152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791839.139194:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606401536 00000100:00100000:1.0:1788791839.139204:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606401536 00000100:00100000:1.0:1788791839.139271:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788791839.139283:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:16747:x1875683606401536:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788791839.139376:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:16747:x1875683606401536:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791839.139385:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000001:00080000:1.0:1788791839.146366:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1788791839.146386:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788791839.148005:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791839.148038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791839.148068:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791839.148094:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606401664 00000100:00100000:2.0:1788791839.148102:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606401664 00000100:00100000:2.0:1788791839.148175:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606401792 00000100:00100000:2.0:1788791839.148178:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606401792 00000100:00100000:2.0:1788791839.148199:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1788791839.148208:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1875683606401664:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788791839.148256:0:19580:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 35fd46c2-6db5-48a7-8c88-eca01b9f5ee2@192.168.201.29@tcp t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:2.0:1788791839.148289:0:19580:0:(genops.c:1385:class_connect()) connect: client 35fd46c2-6db5-48a7-8c88-eca01b9f5ee2, cookie 0xcd6380150a3247ae 00002000:00100000:2.0:1788791839.148301:0:19580:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 35fd46c2-6db5-48a7-8c88-eca01b9f5ee2/ffff9ab982b05800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788791839.148324:0:19580:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788791839.148670:0:19580:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788791839.148700:0:19580:0:(import.c:65:import_set_state_nolock()) ffff9ab982b01000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788791839.148764:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2351:x1875683606401664:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 556us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791839.148773:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1788791839.148791:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1788791839.148797:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1875683606401792:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788791839.148825:0:19580:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 35fd46c2-6db5-48a7-8c88-eca01b9f5ee2@192.168.201.29@tcp t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:2.0:1788791839.148842:0:19580:0:(genops.c:1385:class_connect()) connect: client 35fd46c2-6db5-48a7-8c88-eca01b9f5ee2, cookie 0xcd6380150a3247b5 00002000:00100000:2.0:1788791839.148848:0:19580:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35fd46c2-6db5-48a7-8c88-eca01b9f5ee2/ffff9ab982b03000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788791839.148854:0:19580:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788791839.149056:0:19580:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788791839.149073:0:19580:0:(import.c:65:import_set_state_nolock()) ffff9ab982b04800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788791839.149097:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2351:x1875683606401792:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 299us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791839.149105:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1788791839.150424:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606401920 00000100:00100000:1.0:1788791839.150436:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606401920 00000100:00100000:1.0:1788791839.150497:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:1.0:1788791839.150506:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:16747:x1875683606401920:12345-192.168.201.29@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788791839.153522:0:18898:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2949us 00000004:00200000:3.0:1788791839.180389:0:18898:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1788791839.180577:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:16747:x1875683606401920:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 30066us (32574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791839.180594:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788791839.380483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791839.381331:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606402048 00000100:00100000:3.0:1788791839.381342:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606402048 00000100:00100000:3.0:1788791839.381448:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1788791839.381459:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:16793:x1875683606402048:12345-192.168.201.29@tcp:101:mkdir.0 00010000:00010000:3.0:1788791839.381480:0:18895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791839.381505:0:18895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3247bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367553a expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791839.381571:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a3247c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791839.381585:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a3247c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791839.381599:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a3247c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791839.381824:0:18895:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788791839.381828:0:18895:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1788791839.381936:0:18895:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a3247c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791839.382091:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3247bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367553a expref: 8 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791839.382119:0:18895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a3247c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367553a expref: 7 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791839.382171:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba8823cf00) 00010000:00010000:3.0:1788791839.382175:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788791839.382179:0:18895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c200, rc 0) 00000100:00100000:3.0:1788791839.382508:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:16793:x1875683606402048:12345-192.168.201.29@tcp:101:mkdir.0 Request processed in 1048us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791839.382516:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000001:00100000:1.0:1788791839.629811:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35fd46c2-6db5-48a7-8c88-eca01b9f5ee2 00010000:00010000:2.0:1788791840.039012:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791841.061843:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791841.571561:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788791841.571584:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630512384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791841.571660:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791841.571742:0:19584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630512384 00000100:00100000:1.0:1788791841.571748:0:19584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630512384 00000100:00100000:1.0:1788791841.571808:0:19584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788791841.571825:0:19584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630512384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791841.571859:0:19584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788791841.571926:0:19584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630512384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791841.571934:0:19584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788791841.571953:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630512384:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788791841.572216:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788791842.073259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791842.073394:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606402176 00000100:00100000:1.0:1788791842.073403:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606402176 00000100:00100000:1.0:1788791842.073469:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1788791842.073480:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:16845:x1875683606402176:12345-192.168.201.29@tcp:41:lfs.0 00000004:00000024:1.0:1788791842.073520:0:18896:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788791842.073618:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:16845:x1875683606402176:12345-192.168.201.29@tcp:41:lfs.0 Request processed in 140us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791842.073627:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00080000:3.0:1788791842.073895:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791842.080695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791842.080871:0:19585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606402304 00000100:00100000:0.0:1788791842.080881:0:19585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606402304 00000100:00100000:0.0:1788791842.080953:0:19585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1788791842.080963:0:19585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:16845:x1875683606402304:12345-192.168.201.29@tcp:13:lfs.0 00002000:00000024:0.0:1788791842.080996:0:19585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788791842.081076:0:19585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:16845:x1875683606402304:12345-192.168.201.29@tcp:13:lfs.0 Request processed in 115us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791842.081091:0:19585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00080000:3.0:1788791842.084039:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788791842.084657:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791842.092424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791842.094164:0:19585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606402432 00000100:00100000:0.0:1788791842.094176:0:19585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606402432 00000100:00100000:0.0:1788791842.094263:0:19585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1788791842.094275:0:19585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:16845:x1875683606402432:12345-192.168.201.29@tcp:13:lfs.0 00002000:00000024:0.0:1788791842.094310:0:19585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791842.094397:0:19585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:16845:x1875683606402432:12345-192.168.201.29@tcp:13:lfs.0 Request processed in 124us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791842.094405:0:19585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00080000:3.0:1788791842.095393:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788791842.399796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791842.402433:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606402560 00000100:00100000:0.0:1788791842.402448:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606402560 00000100:00100000:0.0:1788791842.402517:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:0.0:1788791842.402541:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+10:16875:x1875683606402560:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788791842.402558:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791842.402577:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ab981c8c600/0xcd6380150a3247ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453675541 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791842.402621:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ab981c8c600/0xcd6380150a3247ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675541 expref: 11 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791842.402633:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ab981c8c600/0xcd6380150a3247ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675541 expref: 11 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791842.402643:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ab981c8c600, rc 0) 00000100:00100000:0.0:1788791842.402716:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+11:16875:x1875683606402560:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 177us (2929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791842.402723:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:2.0:1788791842.417227:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791842.417490:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606402688 00000100:00100000:0.0:1788791842.417501:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606402688 00000100:00100000:0.0:1788791842.417561:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:0.0:1788791842.417572:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+11:16875:x1875683606402688:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788791842.418333:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+11:16875:x1875683606402688:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 761us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791842.418343:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:2.0:1788791842.421749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791842.422181:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606402816 00000100:00100000:1.0:1788791842.422191:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606402816 00000100:00100000:1.0:1788791842.422781:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:1.0:1788791842.422795:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+11:16875:x1875683606402816:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788791842.424705:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+11:16875:x1875683606402816:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 1898us (2949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791842.424732:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:1.0:1788791842.452277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791842.453850:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606402944 00000100:00100000:2.0:1788791842.453864:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606402944 00000100:00100000:2.0:1788791842.453940:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:2.0:1788791842.453950:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+11:16884:x1875683606402944:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788791842.454681:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+11:16884:x1875683606402944:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 730us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791842.454692:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:2.0:1788791842.530503:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791842.539329:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606403072 00000100:00100000:1.0:1788791842.539345:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606403072 00000100:00100000:1.0:1788791842.539415:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:1.0:1788791842.539426:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+11:16884:x1875683606403072:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788791842.539728:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+11:16884:x1875683606403072:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 303us (9233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791842.539736:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:1.0:1788791842.548673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791842.549100:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606403200 00000100:00100000:0.0:1788791842.549111:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606403200 00000100:00100000:0.0:1788791842.549186:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:0.0:1788791842.549197:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+11:16875:x1875683606403200:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788791842.549223:0:18890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791842.549255:0:18890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ab981c8d800/0xcd6380150a3247d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a945367556b expref: -99 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791842.549284:0:18890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ab981c8d800/0xcd6380150a3247d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367556b expref: 12 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791842.549295:0:18890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ab981c8d800/0xcd6380150a3247d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367556b expref: 12 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791842.549305:0:18890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ab981c8d800, rc 0) 00000100:00100000:0.0:1788791842.549365:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+12:16875:x1875683606403200:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 169us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791842.549372:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:3.0:1788791842.559318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791842.559483:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606403328 00000100:00100000:2.0:1788791842.559492:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606403328 00000100:00100000:2.0:1788791842.559564:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:2.0:1788791842.559574:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+12:16875:x1875683606403328:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788791842.559627:0:18888:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788791842.559644:0:18888:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788791842.559648:0:18888:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788791842.559651:0:18888:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788791842.559654:0:18888:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1788791842.563384:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+12:16875:x1875683606403328:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 3800us (4066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791842.563400:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:1.0:1788791842.586170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791842.591869:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606403456 00000100:00100000:2.0:1788791842.591886:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606403456 00000100:00100000:2.0:1788791842.591956:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:2.0:1788791842.591968:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+12:16875:x1875683606403456:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788791842.591982:0:18889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791842.592012:0:18889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ffa00/0xcd6380150a3247d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453675572 expref: -99 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791842.592041:0:18889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ffa00/0xcd6380150a3247d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675572 expref: 13 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791842.592053:0:18889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ffa00/0xcd6380150a3247d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675572 expref: 13 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791842.592063:0:18889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffa00, rc 0) 00000100:00100000:2.0:1788791842.592185:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+13:16875:x1875683606403456:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 219us (6064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791842.592192:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:0.0:1788791842.607105:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791842.607205:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606403584 00000100:00100000:2.0:1788791842.607216:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606403584 00000100:00100000:2.0:1788791842.607276:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:2.0:1788791842.607300:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+13:16875:x1875683606403584:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788791842.608896:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+13:16875:x1875683606403584:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 1591us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791842.608909:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:0.0:1788791842.612908:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791842.613024:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606403712 00000100:00100000:2.0:1788791842.613035:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606403712 00000100:00100000:2.0:1788791842.613118:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:2.0:1788791842.613146:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+13:16875:x1875683606403712:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788791842.616698:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+13:16875:x1875683606403712:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 3560us (3790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791842.616713:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:1.0:1788791842.636690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791842.637066:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606403840 00000100:00100000:2.0:1788791842.637075:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606403840 00000100:00100000:2.0:1788791842.637122:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:2.0:1788791842.637274:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+13:16889:x1875683606403840:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788791842.637735:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+13:16889:x1875683606403840:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 581us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791842.637743:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:1.0:1788791842.652878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791842.653054:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606403968 00000100:00100000:2.0:1788791842.653064:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606403968 00000100:00100000:2.0:1788791842.653117:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:2.0:1788791842.653151:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+13:16889:x1875683606403968:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788791842.653383:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+13:16889:x1875683606403968:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 258us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791842.653400:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:0.0:1788791842.659011:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791842.659052:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791842.659080:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791842.659211:0:19583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606404736 00000100:00100000:1.0:1788791842.659220:0:19583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606404736 00000100:00100000:1.0:1788791842.659271:0:19583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606404608 00000100:00100000:1.0:1788791842.659274:0:19583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606404608 00000100:00100000:1.0:1788791842.659291:0:19583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:1.0:1788791842.659300:0:19583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2352:x1875683606404736:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791842.659367:0:19583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2352:x1875683606404736:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 67us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791842.659374:0:19583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:1.0:1788791842.659390:0:19583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:1.0:1788791842.659396:0:19583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2352:x1875683606404608:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791842.659416:0:19583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2352:x1875683606404608:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 21us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791842.659434:0:19583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1788791842.666668:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606404480 00000100:00100000:2.0:1788791842.666682:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606404480 00000100:00100000:2.0:1788791842.666754:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:2.0:1788791842.666764:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:2352:x1875683606404480:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791842.666848:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:2352:x1875683606404480:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 84us (7846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791842.666855:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788791842.682105:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791842.682250:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606404096 00000100:00100000:1.0:1788791842.682260:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606404096 00000100:00100000:1.0:1788791842.682302:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:1.0:1788791842.682310:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1875683606404096:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788791842.682339:0:18896:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6ab063e8-7e10-4fb9-9b7e-072e56167789@192.168.201.29@tcp t0 exp 0000000000000000 cur 619 last 0 00000020:00000080:1.0:1788791842.682373:0:18896:0:(genops.c:1385:class_connect()) connect: client 6ab063e8-7e10-4fb9-9b7e-072e56167789, cookie 0xcd6380150a3247df 00000004:00100000:1.0:1788791842.682402:0:18896:0:(mdt_handler.c:7331:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788791842.682524:0:18896:0:(import.c:65:import_set_state_nolock()) ffff9ab982a85000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788791842.682595:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:2351:x1875683606404096:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 274us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791842.682603:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:1.0:1788791842.704198:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791842.704646:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606404224 00000100:00100000:2.0:1788791842.704656:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606404224 00000100:00100000:2.0:1788791842.704730:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1788791842.704741:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:0:x1875683606404224:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788791842.704784:0:20097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788791842.704855:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:0:x1875683606404224:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 115us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791842.704863:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00080000:3.0:1788791842.705403:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791842.728100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791842.728341:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606404352 00000100:00100000:1.0:1788791842.728351:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606404352 00000100:00100000:1.0:1788791842.728408:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1788791842.728418:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:16875:x1875683606404352:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788791842.728447:0:18896:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788791842.728522:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:16875:x1875683606404352:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 104us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791842.728530:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788791842.766497:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791842.766835:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606404864 00000100:00100000:3.0:1788791842.766845:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606404864 00000100:00100000:3.0:1788791842.766908:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1788791842.766918:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:16875:x1875683606404864:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788791842.767001:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:16875:x1875683606404864:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 84us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791842.767023:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1788791842.777966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791842.782122:0:19583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606404992 00000100:00100000:2.0:1788791842.782183:0:19583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606404992 00000100:00100000:2.0:1788791842.782238:0:19583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788791842.782246:0:19583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875683606404992:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788791842.782275:0:19583:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6ab063e8-7e10-4fb9-9b7e-072e56167789@192.168.201.29@tcp t0 exp 0000000000000000 cur 619 last 0 00000020:00000080:2.0:1788791842.782307:0:19583:0:(genops.c:1385:class_connect()) connect: client 6ab063e8-7e10-4fb9-9b7e-072e56167789, cookie 0xcd6380150a3247e6 00002000:00100000:2.0:1788791842.782318:0:19583:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6ab063e8-7e10-4fb9-9b7e-072e56167789/ffff9ab982b00000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788791842.782352:0:19583:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788791842.782577:0:19583:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788791842.782623:0:19583:0:(import.c:65:import_set_state_nolock()) ffff9ab982b06000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788791842.782686:0:19583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:2351:x1875683606404992:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 439us (4729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791842.782694:0:19583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788791842.794062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791842.794325:0:18899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606405248 00000100:00100000:0.0:1788791842.794334:0:18899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606405248 00000100:00100000:0.0:1788791842.794386:0:18899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:0.0:1788791842.794395:0:18899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:16875:x1875683606405248:12345-192.168.201.29@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788791842.795039:0:18899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788791842.795229:0:18899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:16875:x1875683606405248:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 834us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791842.795244:0:18899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:0.0:1788791842.797783:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791842.798687:0:20203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606405120 00000100:00100000:3.0:1788791842.798697:0:20203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606405120 00000100:00100000:3.0:1788791842.798745:0:20203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788791842.798753:0:20203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1875683606405120:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788791842.798784:0:20203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6ab063e8-7e10-4fb9-9b7e-072e56167789@192.168.201.29@tcp t0 exp 0000000000000000 cur 619 last 0 00000020:00000080:3.0:1788791842.798817:0:20203:0:(genops.c:1385:class_connect()) connect: client 6ab063e8-7e10-4fb9-9b7e-072e56167789, cookie 0xcd6380150a3247ed 00002000:00100000:3.0:1788791842.798827:0:20203:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6ab063e8-7e10-4fb9-9b7e-072e56167789/ffff9abab2239000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788791842.798837:0:20203:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788791842.798922:0:20203:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788791842.798953:0:20203:0:(import.c:65:import_set_state_nolock()) ffff9ababd8a6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791842.799016:0:20203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:2351:x1875683606405120:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 262us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791842.799024:0:20203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00010000:00010000:2.0:1788791843.112869:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791843.131100:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791843.131325:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606405376 00000100:00100000:2.0:1788791843.131335:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606405376 00000100:00100000:2.0:1788791843.131392:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:2.0:1788791843.131403:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:16910:x1875683606405376:12345-192.168.201.29@tcp:101:mkdir.0 00010000:00010000:2.0:1788791843.131422:0:18896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791843.131446:0:18896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3247f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367559c expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791843.131507:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3247fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791843.131521:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3247fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791843.131533:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3247fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791843.131743:0:18896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788791843.131748:0:18896:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791843.131827:0:18896:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3247fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791843.131866:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3247f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367559c expref: 8 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791843.131883:0:18896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3247fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367559c expref: 7 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791843.131907:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba8823cf00) 00010000:00010000:2.0:1788791843.131910:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788791843.131914:0:18896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe000, rc 0) 00000100:00100000:2.0:1788791843.131972:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+7:16910:x1875683606405376:12345-192.168.201.29@tcp:101:mkdir.0 Request processed in 570us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791843.131978:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000040:00080000:2.0:1788791843.427956:0:18928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788791844.131847:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630512768:0@lo:400:kworker.0 00000100:00100000:3.0:1788791844.131949:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791844.132019:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788791844.132026:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630512640:0@lo:400:kworker.0 00000100:00100000:3.0:1788791844.132065:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791844.132085:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630513152:0@lo:400:kworker.0 00000100:00100000:3.0:1788791844.132154:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791844.132185:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630512896:0@lo:400:kworker.0 00000100:00100000:3.0:1788791844.132218:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791844.132236:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788791844.132260:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3312:1875683630512512:0@lo:400:kworker.0 00000100:00100000:3.0:1788791844.132294:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791844.132320:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630513024:0@lo:400:kworker.0 00000100:00100000:3.0:1788791844.132347:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791844.132377:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630512768 00000100:00100000:3.0:1788791844.132387:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630512768 00000100:00100000:1.0:1788791844.133119:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630513152 00000100:00100000:1.0:1788791844.133151:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630513152 00000100:00100000:1.0:1788791844.133226:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630512896 00000100:00100000:1.0:1788791844.133230:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630512896 00000100:00100000:1.0:1788791844.133243:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630513024 00000100:00100000:1.0:1788791844.133246:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630513024 00000100:00100000:1.0:1788791844.133264:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788791844.133274:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630513152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791844.133384:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630513152:12345-0@lo:400:kworker.0 Request processed in 111us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791844.133392:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788791844.133412:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788791844.133417:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630512896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791844.133454:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630512896:12345-0@lo:400:kworker.0 Request processed in 37us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791844.133460:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788791844.133472:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788791844.133478:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630513024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791844.133504:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630513024:12345-0@lo:400:kworker.0 Request processed in 27us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791844.133510:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788791844.133526:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791844.133574:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630513024:0@lo:400:kworker.0 00000100:00100000:1.0:1788791844.133590:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630512896:0@lo:400:kworker.0 00000100:00100000:1.0:1788791844.133626:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630513152:0@lo:400:kworker.0 00000100:00100000:1.0:1788791844.133764:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630512512 00000100:00100000:1.0:1788791844.133768:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630512512 00000100:00100000:1.0:1788791844.133796:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788791844.133810:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3312:x1875683630512512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791844.133848:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3312:x1875683630512512:12345-0@lo:400:kworker.0 Request processed in 39us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791844.133854:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788791844.134185:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3312:1875683630512512:0@lo:400:kworker.0 00000100:00100000:0.0:1788791844.134887:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788791844.134908:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630513280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791844.134963:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791844.135642:0:19583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630512640 00000100:00100000:2.0:1788791844.135652:0:19583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630512640 00000100:00100000:2.0:1788791844.135722:0:19583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788791844.135732:0:19583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630512640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791844.135791:0:19583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630512640:12345-0@lo:400:kworker.0 Request processed in 60us (3736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791844.135798:0:19583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788791844.135820:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791844.136109:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630512640:0@lo:400:kworker.0 00000100:00100000:2.0:1788791844.136163:0:19585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630513280 00000100:00100000:2.0:1788791844.136167:0:19585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630513280 00000100:00100000:2.0:1788791844.136209:0:19585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788791844.136216:0:19585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630513280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788791844.136254:0:19585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791844.136297:0:19585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630513280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791844.136303:0:19585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788791844.136317:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788791844.136348:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788791844.136371:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630513280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788791844.139727:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791844.139808:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788791844.139822:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630512768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791844.139940:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630512768:12345-0@lo:400:kworker.0 Request processed in 120us (7991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791844.139948:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788791844.140183:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630512768:0@lo:400:kworker.0 00000001:00100000:3.0:1788791844.277405:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6ab063e8-7e10-4fb9-9b7e-072e56167789 00000001:00100000:3.0:1788791844.277428:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35fd46c2-6db5-48a7-8c88-eca01b9f5ee2 00000001:00100000:1.0:1788791844.362035:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35fd46c2-6db5-48a7-8c88-eca01b9f5ee2 00000001:00100000:1.0:1788791844.362061:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6ab063e8-7e10-4fb9-9b7e-072e56167789 00000001:00100000:1.0:1788791844.843620:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6ab063e8-7e10-4fb9-9b7e-072e56167789 00010000:00010000:3.0:1788791845.155398:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791846.179842:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791846.696269:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788791846.696300:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630513408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791846.696461:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791846.697311:0:19585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630513408 00000100:00100000:2.0:1788791846.697334:0:19585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630513408 00000100:00100000:2.0:1788791846.697407:0:19585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788791846.697419:0:19585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630513408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788791846.697475:0:19585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788791846.697550:0:19585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630513408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791846.697559:0:19585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788791846.697639:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630513408:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788791846.699195:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788791847.203745:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791847.985619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791847.985673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791847.985713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791847.985734:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791847.985766:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791847.985782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791847.985802:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791847.985825:0:20203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606405760 00000100:00100000:2.0:1788791847.985845:0:20203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606405760 00000100:00100000:2.0:1788791847.985891:0:20203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606406272 00000100:00100000:2.0:1788791847.985894:0:20203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606406272 00000100:00100000:2.0:1788791847.985907:0:20203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606405888 00000100:00100000:2.0:1788791847.985910:0:20203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606405888 00000100:00100000:2.0:1788791847.985920:0:20203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606406144 00000100:00100000:2.0:1788791847.985922:0:20203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606406144 00000100:00100000:2.0:1788791847.985936:0:20203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1788791847.985945:0:20203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2353:x1875683606405760:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791847.986011:0:20203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2353:x1875683606405760:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 68us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791847.986018:0:20203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1788791847.986032:0:20203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1788791847.986038:0:20203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6ab063e8-7e10-4fb9-9b7e-072e56167789+5:2353:x1875683606406272:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791847.986062:0:20203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6ab063e8-7e10-4fb9-9b7e-072e56167789+5:2353:x1875683606406272:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791847.986068:0:20203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1788791847.986077:0:20203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1788791847.986083:0:20203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2353:x1875683606405888:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791847.986103:0:20203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2353:x1875683606405888:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 20us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791847.986109:0:20203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1788791847.986119:0:20203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788791847.986150:0:20203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6ab063e8-7e10-4fb9-9b7e-072e56167789+5:2353:x1875683606406144:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791847.986174:0:20203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6ab063e8-7e10-4fb9-9b7e-072e56167789+5:2353:x1875683606406144:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 49us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791847.986293:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606405504 00000100:00100000:1.0:1788791847.986298:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606405504 00000100:00100000:1.0:1788791847.986327:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00100000:1.0:1788791847.986334:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+13:2353:x1875683606405504:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791847.986361:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+13:2353:x1875683606405504:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 27us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791847.986367:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00100000:1.0:1788791847.986398:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606406016 00000100:00100000:1.0:1788791847.986403:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606406016 00000100:00100000:1.0:1788791847.986429:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606405632 00000100:00100000:1.0:1788791847.986433:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606405632 00000100:00100000:1.0:1788791847.986455:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:1.0:1788791847.986461:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:2353:x1875683606406016:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791847.986502:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:2353:x1875683606406016:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 30us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791847.986509:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:1.0:1788791847.986529:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1788791847.986535:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2353:x1875683606405632:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791847.986561:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2353:x1875683606405632:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 27us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791847.986567:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00080000:1.0:1788791847.986589:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788791847.986595:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788791847.986597:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791847.986907:0:20203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000001:02000400:2.0:1788791848.040414:0:20860:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788791848.236737:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791849.252103:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630513920:0@lo:400:kworker.0 00000100:00100000:1.0:1788791849.252191:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791849.252256:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788791849.252263:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3312:1875683630513536:0@lo:400:kworker.0 00000100:00100000:2.0:1788791849.252267:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630513664:0@lo:400:kworker.0 00000100:00100000:3.0:1788791849.252332:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630513792:0@lo:400:kworker.0 00010000:00010000:0.0:1788791849.252400:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791849.252458:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630513920 00000100:00100000:0.0:1788791849.252465:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630513920 00000100:00100000:0.0:1788791849.252516:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788791849.252526:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630513920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791849.262241:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791849.262299:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630514176:0@lo:400:kworker.0 00000100:00100000:2.0:1788791849.262340:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791849.262371:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791849.262379:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab7984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630514304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791849.262406:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791849.262495:0:20203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630513664 00000100:00100000:2.0:1788791849.262504:0:20203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630513664 00000100:00100000:2.0:1788791849.262563:0:20203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788791849.262572:0:20203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630513664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791849.262636:0:20203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630513664:12345-0@lo:400:kworker.0 Request processed in 65us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791849.262643:0:20203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788791849.262664:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630514176 00000100:00100000:2.0:1788791849.262668:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630514176 00000100:00100000:2.0:1788791849.262693:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788791849.262699:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630514176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791849.262729:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630514176:12345-0@lo:400:kworker.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791849.262735:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788791849.262752:0:19585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630514304 00000100:00100000:2.0:1788791849.262755:0:19585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630514304 00000100:00100000:2.0:1788791849.262778:0:19585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788791849.267503:0:19585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630514304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788791849.267552:0:19585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791849.267647:0:19585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630514304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (5239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791849.267655:0:19585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788791849.267697:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788791849.267703:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788791849.267706:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791849.268052:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab7984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630514304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791849.268067:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630513664:0@lo:400:kworker.0 00000100:00100000:2.0:1788791849.268078:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630514176:0@lo:400:kworker.0 00000100:00100000:1.0:1788791849.269653:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791849.269712:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630513536 00000100:00100000:1.0:1788791849.269722:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630513536 00000100:00100000:1.0:1788791849.269861:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788791849.269871:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3312:x1875683630513536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791849.270040:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3312:x1875683630513536:12345-0@lo:400:kworker.0 Request processed in 170us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791849.270049:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788791849.270521:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3312:1875683630513536:0@lo:400:kworker.0 00000100:00100000:1.0:1788791849.270536:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630514048:0@lo:400:kworker.0 00000100:00100000:1.0:1788791849.270738:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791849.270831:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630514048 00000100:00100000:1.0:1788791849.270836:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630514048 00000100:00100000:1.0:1788791849.270880:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788791849.270902:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630514048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791849.270945:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630514048:12345-0@lo:400:kworker.0 Request processed in 44us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791849.270951:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788791849.270973:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791849.270993:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630514048:0@lo:400:kworker.0 00000100:00100000:3.0:1788791849.272430:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791849.272631:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630513792 00000100:00100000:1.0:1788791849.272640:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630513792 00000100:00100000:1.0:1788791849.272691:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788791849.272701:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630513792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791849.272877:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630513792:12345-0@lo:400:kworker.0 Request processed in 177us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791849.272886:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788791849.272976:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630513792:0@lo:400:kworker.0 00000100:00100000:0.0:1788791849.273318:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630513920:12345-0@lo:400:kworker.0 Request processed in 20790us (21123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791849.273327:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788791849.273481:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630513920:0@lo:400:kworker.0 00010000:00010000:2.0:1788791850.279338:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791851.305615:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791851.815563:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630514432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791851.815640:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791851.817541:0:19585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630514432 00000100:00100000:3.0:1788791851.817555:0:19585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630514432 00000100:00100000:3.0:1788791851.817624:0:19585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788791851.817635:0:19585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630514432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788791851.817672:0:19585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788791851.817741:0:19585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630514432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791851.817757:0:19585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788791851.818094:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791851.818163:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630514432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788791852.324206:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791853.108174:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791853.108208:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791853.108244:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791853.108270:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791853.108294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791853.108315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791853.108340:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791853.108365:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606406400 00000100:00100000:0.0:1788791853.108374:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606406400 00000100:00100000:0.0:1788791853.108447:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00100000:0.0:1788791853.108458:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+13:2353:x1875683606406400:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791853.108523:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+13:2353:x1875683606406400:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 67us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791853.108531:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00100000:0.0:1788791853.108562:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606406784 00000100:00100000:0.0:1788791853.108566:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606406784 00000100:00100000:0.0:1788791853.108596:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606407040 00000100:00100000:0.0:1788791853.108599:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606407040 00000100:00100000:0.0:1788791853.108611:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606406656 00000100:00100000:0.0:1788791853.108613:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606406656 00000100:00100000:0.0:1788791853.108622:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606407168 00000100:00100000:0.0:1788791853.108625:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606407168 00000100:00100000:0.0:1788791853.108639:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788791853.108646:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2353:x1875683606406784:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791853.108674:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2353:x1875683606406784:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 28us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791853.108680:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788791853.108692:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:0.0:1788791853.108698:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+5:2353:x1875683606407040:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791853.108719:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+5:2353:x1875683606407040:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791853.108726:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:0.0:1788791853.108736:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:0.0:1788791853.108742:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2353:x1875683606406656:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791853.108764:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2353:x1875683606406656:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 22us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791853.108777:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:0.0:1788791853.108790:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788791853.108796:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+5:2353:x1875683606407168:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791853.108822:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+5:2353:x1875683606407168:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791853.108828:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788791853.109077:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606406528 00000100:00100000:0.0:1788791853.109083:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606406528 00000100:00100000:0.0:1788791853.109110:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606406912 00000100:00100000:0.0:1788791853.109113:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606406912 00000100:00100000:0.0:1788791853.109156:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1788791853.109163:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2353:x1875683606406528:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791853.109192:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2353:x1875683606406528:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 30us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791853.109198:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1788791853.109209:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:0.0:1788791853.109215:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:2353:x1875683606406912:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791853.109234:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:2353:x1875683606406912:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 20us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791853.109241:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00080000:0.0:1788791853.109262:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788791853.109266:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788791853.109268:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788791853.348094:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788791853.670276:0:18928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1788791854.272076:0:21008:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd603731d0 20000000:00000080:0.0:1788791854.272094:0:21008:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9aba90a04c00 uarg=0000000000000000 20000000:01000000:0.0:1788791854.272216:0:21008:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788791854.272222:0:21008:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788791854.272226:0:21008:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788791854.273103:0:21009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788791854.274647:0:21008:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788791854.312038:0:21008:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788791854.312399:0:21008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791854.312420:0:21008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ababb16d400/0xcd6380150a3244c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3244ba expref: 18 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791854.312428:0:21008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba851cb000/0xcd6380150a32450e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a324507 expref: 18 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791854.312435:0:21008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ababb92c800/0xcd6380150a32465e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a324657 expref: 18 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791854.312446:0:21008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ababb16d000/0xcd6380150a3247a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675510 expref: 12 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791854.312453:0:21008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba994ffa00/0xcd6380150a3247d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675572 expref: 12 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791854.312461:0:21008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.312608:0:21008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba994ffa00/0xcd6380150a3247d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675572 expref: 12 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.312624:0:21008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9aba994ffa00/0xcd6380150a3247d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675572 expref: 12 pid: 18889 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791854.312640:0:21008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21008:1875683630514560:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791854.312765:0:21008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ababb16d000/0xcd6380150a3247a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675510 expref: 12 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.312785:0:21008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ababb16d000/0xcd6380150a3247a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675510 expref: 12 pid: 18888 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791854.312793:0:21008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb910700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21008:1875683630514688:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791854.312828:0:21008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ababb92c800/0xcd6380150a32465e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a324657 expref: 18 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.312836:0:21008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ababb92c800/0xcd6380150a32465e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a324657 expref: 18 pid: 18889 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791854.312845:0:21008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21008:1875683630514816:0@lo:104: 00000100:00100000:1.0:1788791854.312883:0:21008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788791854.312925:0:21008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba851cb000/0xcd6380150a32450e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a324507 expref: 18 pid: 18890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.312932:0:21008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9aba851cb000/0xcd6380150a32450e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a324507 expref: 18 pid: 18890 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791854.312939:0:21008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb910e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21008:1875683630514944:0@lo:104: 00000100:00100000:3.0:1788791854.314232:0:18878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630514816 00000100:00100000:3.0:1788791854.314241:0:18878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630514816 00000100:00100000:3.0:1788791854.314307:0:18878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788791854.314328:0:18878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:21008:x1875683630514816:12345-0@lo:104: 00010000:00010000:3.0:1788791854.314343:0:18878:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a32465e expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791854.314415:0:18878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788791854.314421:0:18878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:21008:x1875683630514816:12345-0@lo:104: Request processed in 107us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791854.314429:0:18878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788791854.314597:0:18884:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791854.314605:0:18884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a32465e expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791854.314613:0:18884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16da00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791854.314617:0:18884:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a32465e expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791854.314635:0:18884:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a32465e expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791854.314643:0:18884:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a32465e expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791854.314648:0:18884:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788791854.314723:0:18884:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a32465e expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791854.314730:0:18884:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788791854.314761:0:18884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a32465e expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791854.314768:0:18884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a324657 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a32465e expref: -99 pid: 20296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791854.314782:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791854.314784:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791854.314786:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791854.315221:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791854.315236:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab7987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3312:1875683630515072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791854.315602:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791854.315702:0:18882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630515072 00000100:00100000:2.0:1788791854.315708:0:18882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630515072 00010000:00010000:2.0:1788791854.315734:0:18882:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ababb92c800/0xcd6380150a32465e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a324657 expref: 19 pid: 18889 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791854.315796:0:18882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788791854.315805:0:18882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3312:x1875683630515072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788791854.315817:0:18882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791854.315822:0:18882:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ababb92c800/0xcd6380150a32465e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a324657 expref: 19 pid: 18889 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791854.315845:0:18882:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ababb92c800/0xcd6380150a32465e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a324657 expref: 19 pid: 18889 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791854.315862:0:18882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791854.315900:0:18882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3312:x1875683630515072:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791854.315908:0:18882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788791854.316618:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab7987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3312:1875683630515072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791854.317439:0:21008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791854.317483:0:18878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630514944 00000100:00100000:2.0:1788791854.317489:0:18878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630514944 00000100:00100000:2.0:1788791854.317530:0:18878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788791854.317538:0:18878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:21008:x1875683630514944:12345-0@lo:104: 00010000:00010000:2.0:1788791854.317549:0:18878:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a32450e expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791854.317598:0:18878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788791854.317603:0:18878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:21008:x1875683630514944:12345-0@lo:104: Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791854.317610:0:18878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788791854.317628:0:20559:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791854.317633:0:20559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a32450e expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791854.317640:0:20559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fec00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791854.317643:0:20559:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a32450e expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791854.317663:0:20559:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a32450e expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791854.317670:0:20559:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a32450e expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791854.317675:0:20559:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788791854.317699:0:20559:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a32450e expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791854.317705:0:20559:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791854.317723:0:20559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a32450e expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791854.317729:0:20559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a324507 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a32450e expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791854.317740:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791854.317742:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791854.317743:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791854.317761:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3314:1875683630515328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791854.317793:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791854.317818:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630515328 00000100:00100000:2.0:1788791854.317822:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630515328 00010000:00010000:2.0:1788791854.317837:0:18880:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba851cb000/0xcd6380150a32450e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a324507 expref: 19 pid: 18890 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791854.317864:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788791854.317871:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3314:x1875683630515328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788791854.317887:0:18880:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791854.317892:0:18880:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba851cb000/0xcd6380150a32450e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a324507 expref: 19 pid: 18890 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791854.321887:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791854.321965:0:18882:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788791854.321976:0:18882:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788791854.322211:0:18882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606407296 00000100:00100000:0.0:1788791854.322220:0:18882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606407296 00010000:00010000:0.0:1788791854.322255:0:18882:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba994ffa00/0xcd6380150a3247d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675572 expref: 13 pid: 18889 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.322276:0:21008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ababb16d400/0xcd6380150a3244c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a3244ba expref: 18 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.322292:0:21008:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ababb16d400/0xcd6380150a3244c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a3244ba expref: 19 pid: 18888 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791854.322299:0:18882:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788791854.322661:0:18882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1788791854.322672:0:18882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababab31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:083ef4df-491f-4201-9752-09108931e701+13:2355:x1875683606407296:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791854.322685:0:18882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791854.322692:0:18882:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba994ffa00/0xcd6380150a3247d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675572 expref: 13 pid: 18889 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791854.322741:0:18880:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba851cb000/0xcd6380150a32450e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a324507 expref: 19 pid: 18890 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791854.322762:0:18880:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788791854.322821:0:18882:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba994ffa00/0xcd6380150a3247d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675572 expref: 13 pid: 18889 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791854.322834:0:18882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791854.322920:0:18882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababab31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:083ef4df-491f-4201-9752-09108931e701+13:2355:x1875683606407296:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 250us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791854.322928:0:18882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:1.0:1788791854.323683:0:21008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21008:1875683630515200:0@lo:104: 00000100:00100000:1.0:1788791854.323735:0:21008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791854.323787:0:21008:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba85141a80 going to sleep for 11 seconds 00010000:00010000:1.0:1788791854.323812:0:21008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ffa00/0xcd6380150a3247d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675572 expref: 12 pid: 18889 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791854.323827:0:21008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21008:1875683630514560:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791854.323841:0:21008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb92c800/0xcd6380150a32465e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a324657 expref: 19 pid: 18889 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791854.324527:0:21008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21008:1875683630514816:0@lo:104: 00010000:00010000:1.0:1788791854.324553:0:21008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba851cb000/0xcd6380150a32450e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a324507 expref: 18 pid: 18890 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791854.324564:0:21008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb910e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21008:1875683630514944:0@lo:104: 00000100:00100000:3.0:1788791854.325076:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:3314:x1875683630515328:12345-0@lo:103:ldlm_bl.0 Request processed in 7202us (7280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791854.325087:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788791854.325306:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3314:1875683630515328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791854.325392:0:18878:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788791854.325403:0:18878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630515200 00000100:00100000:2.0:1788791854.325409:0:18878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630515200 00000100:00100000:2.0:1788791854.326957:0:18878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788791854.326972:0:18878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:21008:x1875683630515200:12345-0@lo:104: 00010000:00010000:2.0:1788791854.326988:0:18878:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a3244c1 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791854.327053:0:18878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788791854.327059:0:18878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+3:21008:x1875683630515200:12345-0@lo:104: Request processed in 93us (3325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791854.327065:0:18878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788791854.327179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791854.327211:0:18882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606407424 00000100:00100000:1.0:1788791854.327217:0:18882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606407424 00010000:00010000:1.0:1788791854.327242:0:18882:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ababb16d000/0xcd6380150a3247a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675510 expref: 12 pid: 18888 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791854.327266:0:18882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788791854.327273:0:18882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:083ef4df-491f-4201-9752-09108931e701+12:2355:x1875683606407424:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791854.327284:0:18882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791854.327289:0:18882:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ababb16d000/0xcd6380150a3247a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675510 expref: 12 pid: 18888 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.327300:0:18882:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ababb16d000/0xcd6380150a3247a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675510 expref: 12 pid: 18888 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.327318:0:18882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791854.327405:0:18882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:083ef4df-491f-4201-9752-09108931e701+12:2355:x1875683606407424:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 107us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791854.327412:0:18882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00010000:00010000:1.0:1788791854.327511:0:21008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16d000/0xcd6380150a3247a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675510 expref: 11 pid: 18888 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791854.327524:0:21008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb910700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21008:1875683630514688:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791854.327534:0:21008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21008:1875683630515200:0@lo:104: 00010000:00010000:1.0:1788791854.327565:0:21008:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329087:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791854.329096:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a3244c1 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329106:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791854.329111:0:18883:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a3244c1 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329119:0:18883:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a3244c1 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791854.329275:0:18883:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a3244c1 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791854.329283:0:18883:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788791854.329329:0:18883:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a3244c1 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329335:0:18883:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791854.329368:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a3244c1 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329375:0:18883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a3244ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a3244c1 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329401:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791854.329403:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791854.329405:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791854.329419:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3315:1875683630515456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791854.329467:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791854.329524:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630515456 00000100:00100000:1.0:1788791854.329530:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630515456 00010000:00010000:1.0:1788791854.329550:0:18881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ababb16d400/0xcd6380150a3244c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a3244ba expref: 17 pid: 18888 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791854.329573:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788791854.329582:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:3315:x1875683630515456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791854.329593:0:18881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791854.329597:0:18881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ababb16d400/0xcd6380150a3244c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a3244ba expref: 17 pid: 18888 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329608:0:18881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ababb16d400/0xcd6380150a3244c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a3244ba expref: 17 pid: 18888 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329621:0:18881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16d400/0xcd6380150a3244c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a3244ba expref: 17 pid: 18888 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329633:0:18881:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329652:0:18881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329667:0:18881:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329674:0:18881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329681:0:18881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329687:0:18881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329692:0:18881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8dc00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791854.329696:0:18881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329702:0:18881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329716:0:18881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329725:0:18881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791854.329756:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:3315:x1875683630515456:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791854.329764:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788791854.329796:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3315:1875683630515456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791854.329828:0:21008:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329836:0:21008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791854.329842:0:21008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ab981c8dc00/0xcd6380150a324802 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791854.420787:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788791854.420809:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab7986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630515584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791854.420873:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791854.420926:0:19585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630515584 00000100:00100000:0.0:1788791854.420933:0:19585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630515584 00000100:00100000:0.0:1788791854.420980:0:19585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788791854.420988:0:19585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630515584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791854.421019:0:19585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791854.421055:0:19585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630515584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791854.421076:0:19585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788791854.421094:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788791854.421121:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab7986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630515584:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788791854.421169:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791854.438079:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630515712:0@lo:400:kworker.0 00000100:00100000:1.0:1788791854.438169:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791854.438213:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788791854.438218:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630516096:0@lo:400:kworker.0 00000100:00100000:1.0:1788791854.438239:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791854.438260:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630515840:0@lo:400:kworker.0 00000100:00100000:1.0:1788791854.438278:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791854.438308:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791854.438314:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630515968:0@lo:400:kworker.0 00000100:00100000:1.0:1788791854.438334:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791854.438363:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630515712 00000100:00100000:1.0:1788791854.438370:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630515712 00000100:00100000:1.0:1788791854.438452:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788791854.438461:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630515712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791854.438516:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630515712:12345-0@lo:400:kworker.0 Request processed in 55us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791854.438523:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788791854.438545:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630516096 00000100:00100000:1.0:1788791854.438562:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630516096 00000100:00100000:1.0:1788791854.442235:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630515840 00000100:00100000:1.0:1788791854.442250:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630515840 00000100:00100000:1.0:1788791854.442276:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630515968 00000100:00100000:1.0:1788791854.442278:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630515968 00000100:00100000:1.0:1788791854.442311:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788791854.442321:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630516096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791854.442405:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630516096:12345-0@lo:400:kworker.0 Request processed in 86us (4164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791854.442412:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788791854.442427:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788791854.442432:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630515840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791854.442464:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630515840:12345-0@lo:400:kworker.0 Request processed in 32us (4185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791854.442469:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788791854.442478:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788791854.442483:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630515968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791854.442504:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630515968:12345-0@lo:400:kworker.0 Request processed in 21us (4169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791854.442509:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788791854.442535:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788791854.442539:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791854.445453:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630515968:0@lo:400:kworker.0 00000100:00100000:1.0:1788791854.445500:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630515840:0@lo:400:kworker.0 00000100:00100000:1.0:1788791854.445568:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630516096:0@lo:400:kworker.0 00000100:00100000:1.0:1788791854.445579:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630515712:0@lo:400:kworker.0 00010000:00010000:2.0:1788791855.459321:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791856.006524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791856.006724:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606407552 00000100:00100000:1.0:1788791856.006734:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606407552 00000100:00100000:1.0:1788791856.006815:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1788791856.006828:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:17372:x1875683606407552:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788791856.006847:0:20097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791856.006869:0:20097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324809 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536755a3 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.006939:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324810 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.006953:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324810 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.006967:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324810 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.006982:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324817 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.006990:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.006997:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007454:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d000/0xcd6380150a32481e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007464:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d000/0xcd6380150a32481e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007494:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d000/0xcd6380150a32481e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791856.007581:0:20097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788791856.007586:0:20097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791856.007674:0:20097:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d000/0xcd6380150a32481e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007685:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324810 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007691:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324810 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007699:0:20097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324810 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007705:0:20097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92d600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791856.007709:0:20097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324810 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007717:0:20097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324810 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007729:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba8823cf00) 00010000:00010000:1.0:1788791856.007732:0:20097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791856.007736:0:20097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007742:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007766:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007773:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324817 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007779:0:20097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324817 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007784:0:20097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92ca00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791856.007787:0:20097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324817 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007793:0:20097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324817 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007801:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9aba9010cc00) 00010000:00010000:1.0:1788791856.007804:0:20097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791856.007806:0:20097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324817 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007812:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324817 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007845:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324809 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755a3 expref: 8 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007858:0:20097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d000/0xcd6380150a32481e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755a3 expref: 7 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.007876:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9aba9010c200) 00010000:00010000:1.0:1788791856.007878:0:20097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791856.007881:0:20097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92d000, rc 0) 00000100:00100000:1.0:1788791856.007947:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:17372:x1875683606407552:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1122us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791856.007955:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00080000:0.0:1788791856.008041:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791856.019229:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791856.019317:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606407808 00000100:00100000:0.0:1788791856.019325:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606407808 00000100:00100000:0.0:1788791856.019391:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788791856.019402:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:17372:x1875683606407808:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791856.019423:0:18895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791856.019448:0:18895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8dc00/0xcd6380150a324825 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536755aa expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.019532:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a32482c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.019544:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a32482c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.019557:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a32482c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.019571:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a324833 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.019579:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a324833 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.019585:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a324833 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.020008:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8de00/0xcd6380150a32483a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.020282:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8de00/0xcd6380150a32483a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.020290:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8de00/0xcd6380150a32483a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791856.020298:0:18895:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788791856.021163:0:18895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a32482c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021173:0:18895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a32482c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021181:0:18895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a32482c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021188:0:18895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8ce00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791856.021193:0:18895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a32482c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021200:0:18895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a32482c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021213:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9aba9010c200) 00010000:00010000:0.0:1788791856.021216:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791856.021221:0:18895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a32482c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021238:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a32482c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021250:0:18895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a324833 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021257:0:18895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a324833 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021263:0:18895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a324833 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021269:0:18895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8ca00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791856.021272:0:18895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a324833 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021278:0:18895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a324833 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021286:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9abaa0613700) 00010000:00010000:0.0:1788791856.021289:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791856.021292:0:18895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a324833 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021298:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a324833 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021695:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8dc00/0xcd6380150a324825 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755aa expref: 10 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021721:0:18895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8de00/0xcd6380150a32483a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755aa expref: 9 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.021729:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9abaa0613400) 00010000:00010000:0.0:1788791856.021732:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791856.021734:0:18895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ab981c8de00, rc 0) 00000100:00100000:0.0:1788791856.022033:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+9:17372:x1875683606407808:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 2631us (2811us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788791856.022042:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1788791856.037746:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791856.037844:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606407936 00000100:00100000:0.0:1788791856.037854:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606407936 00000100:00100000:0.0:1788791856.037923:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788791856.037942:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+9:17372:x1875683606407936:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788791856.038053:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+9:17372:x1875683606407936:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 Request processed in 113us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791856.038061:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:2.0:1788791856.118516:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791856.118608:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606408064 00000100:00100000:1.0:1788791856.118617:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606408064 00000100:00100000:1.0:1788791856.118679:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 107 00000100:00100000:1.0:1788791856.118690:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+11:16761:x1875683606408064:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788791856.118707:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791856.118727:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb92ca00/0xcd6380150a324848 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a94536755b1 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.118754:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb92ca00/0xcd6380150a324848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755b1 expref: 12 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.118765:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb92ca00/0xcd6380150a324848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755b1 expref: 12 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.118774:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92ca00, rc 0) 00000100:00100000:1.0:1788791856.118834:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+12:16761:x1875683606408064:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 146us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791856.118842:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 107 00000100:00100000:1.0:1788791856.120511:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791856.120597:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606408192 00000100:00100000:2.0:1788791856.120605:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606408192 00000100:00100000:2.0:1788791856.120664:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:2.0:1788791856.120675:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+9:17378:x1875683606408192:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791856.120691:0:18896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791856.120716:0:18896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32484f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536755b8 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.120775:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324856 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.120787:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324856 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.120799:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324856 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.120813:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32485d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.120820:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32485d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.120827:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32485d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121282:0:18896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324856 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121292:0:18896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324856 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121299:0:18896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324856 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121305:0:18896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791856.121310:0:18896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324856 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121409:0:18896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324856 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121422:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba8823cf00) 00010000:00010000:2.0:1788791856.121426:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791856.121430:0:18896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324856 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121437:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324856 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121450:0:18896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32485d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121456:0:18896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32485d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121463:0:18896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32485d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121468:0:18896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791856.121471:0:18896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32485d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121478:0:18896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32485d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121485:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9aba8533ff00) 00010000:00010000:2.0:1788791856.121488:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791856.121491:0:18896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32485d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121506:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32485d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121539:0:18896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32484f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755b8 expref: 10 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121550:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba8823cf00) 00010000:00010000:2.0:1788791856.121552:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791856.121556:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32484f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755b8 expref: 10 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.121567:0:18896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe600, rc 0) 00000100:00100000:2.0:1788791856.121664:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+9:17378:x1875683606408192:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 990us (1158us total) trans 0 rc 301/301 00000100:00100000:2.0:1788791856.121672:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1788791856.140337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791856.140567:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606408320 00000100:00100000:1.0:1788791856.140577:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606408320 00000100:00100000:1.0:1788791856.140633:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 108 00000100:00100000:1.0:1788791856.140643:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+12:16761:x1875683606408320:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791856.140925:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+12:16761:x1875683606408320:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 282us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791856.140935:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 108 00000100:00100000:3.0:1788791856.144618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791856.144872:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606408448 00000100:00100000:0.0:1788791856.144882:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606408448 00000100:00100000:0.0:1788791856.144946:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:0.0:1788791856.144956:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+12:16761:x1875683606408448:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788791856.148322:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:083ef4df-491f-4201-9752-09108931e701+12:16761:x1875683606408448:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 3350us (3696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791856.148339:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:1.0:1788791856.158802:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791856.159987:0:18904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606408576 00000100:00100000:0.0:1788791856.159998:0:18904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606408576 00000100:00100000:0.0:1788791856.160054:0:18904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1788791856.160065:0:18904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+9:17378:x1875683606408576:12345-192.168.201.29@tcp:700:lfs.0 00000100:00100000:0.0:1788791856.161673:0:18904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+9:17378:x1875683606408576:12345-192.168.201.29@tcp:700:lfs.0 Request processed in 1594us (2865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791856.161687:0:18904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1788791856.165087:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791856.165880:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606408704 00000100:00100000:3.0:1788791856.165892:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606408704 00000100:00100000:3.0:1788791856.165946:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 110 00000100:00100000:3.0:1788791856.165955:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+12:16761:x1875683606408704:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791856.165971:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791856.165989:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16c600/0xcd6380150a324864 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a94536755bf expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.166015:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16c600/0xcd6380150a324864 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755bf expref: 13 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.166040:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16c600/0xcd6380150a324864 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755bf expref: 13 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.166048:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c600, rc 0) 00000100:00100000:3.0:1788791856.166102:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+13:16761:x1875683606408704:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 148us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791856.166109:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 110 00000100:00100000:0.0:1788791856.167099:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791856.167753:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606408960 00000100:00100000:3.0:1788791856.167762:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606408960 00000100:00100000:3.0:1788791856.167816:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:3.0:1788791856.167825:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+9:17378:x1875683606408960:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:3.0:1788791856.167871:0:20097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791856.167896:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a3247c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367553a expref: 9 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.167912:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba8823cf00) 00010000:00010000:3.0:1788791856.167916:0:20097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791856.169220:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.169242:0:20097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3247fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367559c expref: 5 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.169251:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.169285:0:20097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3247fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367559c expref: 5 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.169308:0:20097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3247fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367559c expref: 5 pid: 18896 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791856.169322:0:20097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20097:1875683630516224:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791856.169813:0:20097:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98dff900 going to sleep for 11 seconds 00000100:00100000:2.0:1788791856.195192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791856.195326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791856.195430:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606409088 00000100:00100000:1.0:1788791856.195439:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606409088 00000100:00100000:1.0:1788791856.195503:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 111 00000100:00100000:1.0:1788791856.195512:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+13:16761:x1875683606409088:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791856.195798:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:083ef4df-491f-4201-9752-09108931e701+13:16761:x1875683606409088:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 286us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791856.195807:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 111 00000100:00100000:0.0:1788791856.197548:0:18882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606409216 00000100:00100000:0.0:1788791856.197562:0:18882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606409216 00010000:00010000:0.0:1788791856.197630:0:18882:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3247fb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367559c expref: 6 pid: 18896 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791856.197681:0:18882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788791856.197690:0:18882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:2355:x1875683606409216:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791856.197703:0:18882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791856.197711:0:18882:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3247fb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367559c expref: 6 pid: 18896 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.197724:0:18882:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3247fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367559c expref: 6 pid: 18896 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.197745:0:18882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba8823cf00) 00010000:00010000:0.0:1788791856.197751:0:18882:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.197760:0:18882:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.197779:0:18882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.197797:0:18882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791856.197845:0:18882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:2355:x1875683606409216:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 155us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791856.197853:0:18882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00010000:00010000:3.0:1788791856.199973:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3247fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367559c expref: 5 pid: 18896 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791856.199996:0:20097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20097:1875683630516224:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791856.200017:0:20097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.200026:0:20097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.200032:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.200056:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a324872 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.200066:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a324872 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.200076:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a324872 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788791856.201772:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788791856.204407:0:20097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788791856.204425:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.204436:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.204443:0:20097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.204449:0:20097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791856.204460:0:20097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.204535:0:20097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.204553:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba8823cf00) 00010000:00010000:2.0:1788791856.204556:0:20097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791856.204561:0:20097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.204568:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32486b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788791856.204587:0:20097:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000033f8abf7 reply state 00000000b4add7c3 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a324872 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791856.204597:0:20097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788791856.204698:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+10:17378:x1875683606408960:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 36869us (37598us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788791856.204708:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:0.0:1788791856.205072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791856.205486:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606409344 00000100:00100000:3.0:1788791856.205502:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606409344 00000100:00100000:3.0:1788791856.205548:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 112 00000100:00100000:3.0:1788791856.205558:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+13:16761:x1875683606409344:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791856.205728:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+13:16761:x1875683606409344:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 170us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791856.205735:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 112 00010000:00010000:1.0:1788791856.210174:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a324872 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.210192:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a324872 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.210201:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a324872 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.210207:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791856.210212:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a324872 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.210233:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a324872 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.210250:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9aba8823c600) 00010000:00010000:1.0:1788791856.210254:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791856.210258:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a324872 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.210264:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a324872 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791856.291257:0:18892:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788791856.291265:0:18892:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9abaa0086000 from 10 10000000:01000000:3.0:1788791856.291271:0:18892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788791856.291319:0:18892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a324879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.291331:0:18892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a324879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.291352:0:18892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a324879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791856.291379:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630516352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788791856.291450:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791856.291533:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98dff9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791856.292304:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630516352 00000100:00100000:2.0:1788791856.292312:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630516352 00000100:00100000:2.0:1788791856.292376:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788791856.292385:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa7043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+16:18892:x1875683630516352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791856.292398:0:18889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791856.292412:0:18889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ff200/0xcd6380150a324880 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a324879 expref: -99 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.292436:0:18889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff200/0xcd6380150a324880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a324879 expref: 17 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.292608:0:18889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ff200/0xcd6380150a324880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a324879 expref: 17 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.292620:0:18889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff200, rc 0) 00000100:00100000:2.0:1788791856.292669:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa7043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:18892:x1875683630516352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 285us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791856.292676:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788791856.292792:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630516352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791856.292806:0:18892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a324879 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324880 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.292815:0:18892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a324879 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a324880 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791856.292873:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630516480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791856.292908:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791856.292940:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98dff9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791856.293799:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630516480 00000100:00100000:2.0:1788791856.293805:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630516480 00000100:00100000:2.0:1788791856.293845:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788791856.293853:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:18892:x1875683630516480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791856.294119:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:18892:x1875683630516480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791856.294351:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630516480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791856.294385:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630516608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791856.294426:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791856.294455:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98dff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791856.294546:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630516608 00000100:00100000:0.0:1788791856.294551:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630516608 00000100:00100000:0.0:1788791856.294571:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788791856.294578:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:18892:x1875683630516608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788791856.294728:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:18892:x1875683630516608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791856.294736:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788791856.294891:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788791856.294971:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630516608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788791856.296032:0:21023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788791856.296661:0:18892:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788791856.296683:0:18892:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788791856.296692:0:18892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a324879 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324880 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.296703:0:18892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a324879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324880 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791856.296712:0:18892:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788791856.296715:0:18892:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9abab9a60800 from 10 10000000:01000000:3.0:1788791856.296718:0:18892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788791856.296746:0:18892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16d200/0xcd6380150a324887 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.296754:0:18892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb16d200/0xcd6380150a324887 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.296764:0:18892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb16d200/0xcd6380150a324887 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791856.296782:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630516736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788791856.296834:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791856.296874:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98dff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791856.296933:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630516736 00000100:00100000:0.0:1788791856.296939:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630516736 00000100:00100000:0.0:1788791856.296980:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788791856.296989:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+17:18892:x1875683630516736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791856.297000:0:18889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791856.297029:0:18889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ab981c8cc00/0xcd6380150a32488e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a324887 expref: -99 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.297050:0:18889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ab981c8cc00/0xcd6380150a32488e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a324887 expref: 18 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.297061:0:18889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ab981c8cc00/0xcd6380150a32488e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a324887 expref: 18 pid: 18889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.297077:0:18889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ab981c8cc00, rc 0) 00000100:00100000:0.0:1788791856.297120:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:18892:x1875683630516736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791856.297153:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788791856.297325:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630516736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791856.297338:0:18892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb16d200/0xcd6380150a324887 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32488e expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.297361:0:18892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb16d200/0xcd6380150a324887 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a32488e expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791856.297408:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630516864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791856.297435:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791856.297457:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98dff9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791856.297678:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630516864 00000100:00100000:1.0:1788791856.297683:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630516864 00000100:00100000:1.0:1788791856.297705:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788791856.297712:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:18892:x1875683630516864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791856.297954:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:18892:x1875683630516864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791856.297964:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788791856.298064:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630516864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791856.298097:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630516992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791856.298162:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791856.298181:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98dff9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791856.298247:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630516992 00000100:00100000:2.0:1788791856.298252:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630516992 00000100:00100000:2.0:1788791856.298288:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788791856.298295:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:18892:x1875683630516992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791856.298457:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:18892:x1875683630516992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791856.298474:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788791856.298969:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc146300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630516992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788791856.300408:0:21024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788791856.300730:0:18892:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788791856.300746:0:18892:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788791856.300757:0:18892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16d200/0xcd6380150a324887 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32488e expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.300767:0:18892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16d200/0xcd6380150a324887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32488e expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791856.300778:0:18892:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788791856.300780:0:18892:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9abab29de000 from 10 10000000:01000000:0.0:1788791856.300783:0:18892:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788791856.300812:0:18892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ab981c8c200/0xcd6380150a324895 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.300821:0:18892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ab981c8c200/0xcd6380150a324895 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.300830:0:18892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ab981c8c200/0xcd6380150a324895 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791856.300844:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab7987100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630517120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788791856.300880:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791856.300909:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98323b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788791856.300947:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630517120 00000100:00100000:2.0:1788791856.300952:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630517120 00000100:00100000:2.0:1788791856.300981:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788791856.300987:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+18:18892:x1875683630517120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791856.301002:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791856.301023:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ff000/0xcd6380150a32489c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a324895 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.301038:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff000/0xcd6380150a32489c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a324895 expref: 19 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.301045:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ff000/0xcd6380150a32489c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a324895 expref: 19 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.301051:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff000, rc 0) 00000100:00100000:2.0:1788791856.301081:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:18892:x1875683630517120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791856.301086:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788791856.301263:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab7987100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630517120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791856.301278:0:18892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ab981c8c200/0xcd6380150a324895 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32489c expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.301284:0:18892:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ab981c8c200/0xcd6380150a324895 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a32489c expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791856.301317:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab7987100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630517248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788791856.301341:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791856.301378:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98323b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788791856.301418:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630517248 00000100:00100000:2.0:1788791856.301421:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630517248 00000100:00100000:2.0:1788791856.301443:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788791856.301448:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:18892:x1875683630517248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791856.301767:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:18892:x1875683630517248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791856.301772:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788791856.301854:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab7987100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630517248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791856.301875:0:18892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630517376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791856.301902:0:18892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791856.301910:0:18892:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba85141cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791856.301954:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630517376 00000100:00100000:3.0:1788791856.301958:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630517376 00000100:00100000:3.0:1788791856.301972:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788791856.301976:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:18892:x1875683630517376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791856.302235:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:18892:x1875683630517376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 257us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791856.302239:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788791856.303179:0:18892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bac980b1-b5e1-46bc-b749-0bf83764d3cb:18892:1875683630517376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788791856.306941:0:21025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788791856.307397:0:18892:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788791856.307419:0:18892:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788791856.307428:0:18892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ab981c8c200/0xcd6380150a324895 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32489c expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.307436:0:18892:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ab981c8c200/0xcd6380150a324895 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a32489c expref: -99 pid: 18892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791856.312045:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791856.312491:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606409472 00000100:00100000:0.0:1788791856.312502:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606409472 00000100:00100000:0.0:1788791856.312563:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1788791856.312574:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+9:17388:x1875683606409472:12345-192.168.201.29@tcp:101:lctl.0 00010000:00010000:0.0:1788791856.312597:0:18895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791856.312619:0:18895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a3248a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536755c6 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.312682:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c400/0xcd6380150a3248aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.312696:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c400/0xcd6380150a3248aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.312707:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c400/0xcd6380150a3248aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791856.312763:0:18895:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788791856.312768:0:18895:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791856.312811:0:18895:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c400/0xcd6380150a3248aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.312844:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a3248a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755c6 expref: 11 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.312861:0:18895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c400/0xcd6380150a3248aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755c6 expref: 10 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.312870:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613700) 00010000:00010000:0.0:1788791856.312872:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788791856.312876:0:18895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ab981c8c400, rc 0) 00000100:00100000:0.0:1788791856.312941:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+10:17388:x1875683606409472:12345-192.168.201.29@tcp:101:lctl.0 Request processed in 369us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791856.312949:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1788791856.344110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791856.344383:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606409600 00000100:00100000:2.0:1788791856.344395:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606409600 00000100:00100000:2.0:1788791856.344452:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:2.0:1788791856.344463:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ab063e8-7e10-4fb9-9b7e-072e56167789+5:17389:x1875683606409600:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791856.344484:0:18897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791856.344514:0:18897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536755cd expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.344578:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3248b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.344593:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3248b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.344605:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3248b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791856.344672:0:18897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788791856.344676:0:18897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791856.344702:0:18897:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3248b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.344724:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755cd expref: 7 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.344743:0:18897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3248b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755cd expref: 6 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.344771:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613700) 00010000:00010000:2.0:1788791856.344775:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788791856.344779:0:18897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe200, rc 0) 00000100:00100000:2.0:1788791856.344838:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:17389:x1875683606409600:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 377us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791856.344846:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:3.0:1788791856.351287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791856.351480:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606409728 00000100:00100000:0.0:1788791856.351490:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606409728 00000100:00100000:0.0:1788791856.351567:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:0.0:1788791856.351578:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6ab063e8-7e10-4fb9-9b7e-072e56167789+6:17389:x1875683606409728:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791856.351598:0:18895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791856.351616:0:18895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a3248bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536755d4 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351675:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a3248c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351687:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a3248c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351713:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a3248c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351728:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a3248cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351736:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a3248cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351742:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a3248cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351840:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a3248d4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351847:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a3248d4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351854:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a3248d4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791856.351889:0:18895:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788791856.351893:0:18895:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791856.351937:0:18895:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a3248d4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351949:0:18895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a3248c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351955:0:18895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a3248c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351974:0:18895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a3248c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351981:0:18895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8d200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791856.351985:0:18895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a3248c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.351993:0:18895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a3248c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.352005:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613700) 00010000:00010000:0.0:1788791856.352008:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791856.352012:0:18895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a3248c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.352019:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a3248c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.352031:0:18895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a3248cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.352037:0:18895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a3248cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.352044:0:18895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a3248cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.352049:0:18895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8d600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791856.352052:0:18895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a3248cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.352068:0:18895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a3248cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.352077:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9abaa0613500) 00010000:00010000:0.0:1788791856.352079:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791856.352082:0:18895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a3248cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.352088:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a3248cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.352118:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a3248bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755d4 expref: 8 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.352193:0:18895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a3248d4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755d4 expref: 7 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.352202:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9abaa0613a00) 00010000:00010000:0.0:1788791856.352205:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788791856.352208:0:18895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ab981c8d400, rc 0) 00000100:00100000:0.0:1788791856.352490:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6ab063e8-7e10-4fb9-9b7e-072e56167789+7:17389:x1875683606409728:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 913us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791856.352498:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:1.0:1788791856.358449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791856.358552:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606409984 00000100:00100000:2.0:1788791856.358562:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606409984 00000100:00100000:2.0:1788791856.358622:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788791856.358632:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ab063e8-7e10-4fb9-9b7e-072e56167789+7:17389:x1875683606409984:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791856.358652:0:18897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791856.358671:0:18897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536755db expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791856.358775:0:18897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788791856.358889:0:18897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755db expref: 9 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.358904:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613700) 00010000:00010000:2.0:1788791856.358907:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791856.358911:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755db expref: 9 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.358943:0:18897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fec00, rc 0) 00000100:00100000:2.0:1788791856.359002:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ab063e8-7e10-4fb9-9b7e-072e56167789+8:17389:x1875683606409984:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 370us (561us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788791856.359023:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:1.0:1788791856.367751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791856.367848:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606410240 00000100:00100000:2.0:1788791856.367857:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606410240 00000100:00100000:2.0:1788791856.367915:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:2.0:1788791856.367937:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+8:17389:x1875683606410240:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:2.0:1788791856.367987:0:18896:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791856.368012:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a3248d4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755d4 expref: 8 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.368031:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9abaa0613a00) 00010000:00010000:2.0:1788791856.368041:0:18896:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788791856.368062:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248e9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.368073:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248e9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.368082:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248e9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788791856.368583:0:18896:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000007a503e08 reply state 00000000cf4662d9 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248e9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791856.368593:0:18896:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788791856.368606:0:18896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1788791856.368678:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+9:17389:x1875683606410240:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 742us (936us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788791856.368685:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00010000:00010000:2.0:1788791856.373097:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248e9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.373116:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248e9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.373148:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248e9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.373163:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fec00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791856.373169:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248e9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.373177:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248e9 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.373195:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:2.0:1788791856.373199:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788791856.373204:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248e9 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.373211:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248e9 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791856.374044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791856.378374:0:18899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606410496 00000100:00100000:0.0:1788791856.378392:0:18899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606410496 00000100:00100000:0.0:1788791856.378464:0:18899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:0.0:1788791856.378475:0:18899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+8:17389:x1875683606410496:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788791856.378765:0:18899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+9:17389:x1875683606410496:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 291us (4726us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788791856.378773:0:18899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1788791856.384724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791856.387877:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606410752 00000100:00100000:2.0:1788791856.387905:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606410752 00000100:00100000:2.0:1788791856.387977:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:2.0:1788791856.387988:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ab063e8-7e10-4fb9-9b7e-072e56167789+9:17389:x1875683606410752:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791856.388010:0:18897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791856.388030:0:18897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536755e2 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388120:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3248f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388168:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3248f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388180:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3248f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388196:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a3248fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388202:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a3248fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388210:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a3248fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791856.388352:0:18897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788791856.388443:0:18897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3248f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388450:0:18897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3248f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388457:0:18897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3248f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388464:0:18897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791856.388469:0:18897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3248f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388486:0:18897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3248f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388499:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613700) 00010000:00010000:2.0:1788791856.388502:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791856.388507:0:18897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3248f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388513:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3248f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388525:0:18897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a3248fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388532:0:18897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a3248fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388538:0:18897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a3248fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388543:0:18897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffa00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791856.388546:0:18897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a3248fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388553:0:18897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a3248fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388560:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9aba8533ff00) 00010000:00010000:2.0:1788791856.388562:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791856.388565:0:18897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a3248fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388579:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a3248fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388617:0:18897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755e2 expref: 11 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388628:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613700) 00010000:00010000:2.0:1788791856.388630:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791856.388634:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3248f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755e2 expref: 11 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.388642:0:18897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fec00, rc 0) 00000100:00100000:2.0:1788791856.388711:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ab063e8-7e10-4fb9-9b7e-072e56167789+10:17389:x1875683606410752:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 725us (3996us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788791856.388718:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:1.0:1788791856.392564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791856.392761:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606410880 00000100:00100000:0.0:1788791856.392772:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606410880 00000100:00100000:0.0:1788791856.392829:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:0.0:1788791856.392839:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6ab063e8-7e10-4fb9-9b7e-072e56167789+10:17389:x1875683606410880:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791856.392859:0:20097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791856.392882:0:20097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a32490c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536755e9 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.393034:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324913 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.393047:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324913 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.393059:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324913 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791856.393106:0:20097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788791856.393110:0:20097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791856.393468:0:20097:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324913 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.393493:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a32490c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755e9 expref: 12 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.393522:0:20097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324913 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755e9 expref: 11 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.393544:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9abaa0613500) 00010000:00010000:0.0:1788791856.393548:0:20097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788791856.393552:0:20097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ab981c8d600, rc 0) 00000100:00100000:0.0:1788791856.393605:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6ab063e8-7e10-4fb9-9b7e-072e56167789+11:17389:x1875683606410880:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 767us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791856.393613:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:1.0:1788791856.399620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791856.399895:0:18899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606411008 00000100:00100000:0.0:1788791856.399907:0:18899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606411008 00000100:00100000:0.0:1788791856.399968:0:18899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:0.0:1788791856.399979:0:18899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+11:17389:x1875683606411008:12345-192.168.201.29@tcp:37:lfs.0 00000100:00100000:3.0:1788791856.419020:0:18899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+11:17389:x1875683606411008:12345-192.168.201.29@tcp:37:lfs.0 Request processed in 19031us (19397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791856.419033:0:18899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:1.0:1788791856.429774:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791856.430096:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606411264 00000100:00100000:3.0:1788791856.430107:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606411264 00000100:00100000:3.0:1788791856.430316:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1788791856.430327:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86390050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6ab063e8-7e10-4fb9-9b7e-072e56167789+11:17389:x1875683606411264:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:3.0:1788791856.430673:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86390050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6ab063e8-7e10-4fb9-9b7e-072e56167789+12:17389:x1875683606411264:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 347us (908us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788791856.430682:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00010000:00010000:1.0:1788791856.487602:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791856.558867:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791856.559090:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606411392 00000100:00100000:0.0:1788791856.559099:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606411392 00000100:00100000:0.0:1788791856.559177:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:0.0:1788791856.559188:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+10:17395:x1875683606411392:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788791856.559209:0:18897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791856.559238:0:18897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a32491a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536755f0 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559302:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d000/0xcd6380150a324921 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559317:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d000/0xcd6380150a324921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559327:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d000/0xcd6380150a324921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559386:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324928 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559394:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559401:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559508:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a32492f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559518:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a32492f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559524:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a32492f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791856.559553:0:18897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788791856.559556:0:18897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791856.559597:0:18897:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a32492f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559610:0:18897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d000/0xcd6380150a324921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559617:0:18897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d000/0xcd6380150a324921 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559623:0:18897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d000/0xcd6380150a324921 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559638:0:18897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791856.559642:0:18897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d000/0xcd6380150a324921 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559662:0:18897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d000/0xcd6380150a324921 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559676:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613700) 00010000:00010000:0.0:1788791856.559679:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791856.559684:0:18897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d000/0xcd6380150a324921 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559689:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d000/0xcd6380150a324921 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559702:0:18897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559709:0:18897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324928 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559714:0:18897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559718:0:18897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8ce00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791856.559721:0:18897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559727:0:18897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324928 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559758:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9abaa0613000) 00010000:00010000:0.0:1788791856.559761:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791856.559763:0:18897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324928 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559768:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324928 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559806:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a32491a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755f0 expref: 12 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559820:0:18897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ca00/0xcd6380150a32492f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755f0 expref: 11 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.559828:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9abaa0613500) 00010000:00010000:0.0:1788791856.559830:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788791856.559833:0:18897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ab981c8ca00, rc 0) 00000100:00100000:0.0:1788791856.560209:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+11:17395:x1875683606411392:12345-192.168.201.29@tcp:101:bash.0 Request processed in 1021us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791856.560326:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:3.0:1788791856.576419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791856.576606:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606411648 00000100:00100000:2.0:1788791856.576616:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606411648 00000100:00100000:2.0:1788791856.576685:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:2.0:1788791856.576694:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+11:17395:x1875683606411648:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788791856.576716:0:18895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791856.576735:0:18895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324936 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536755f7 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.576866:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.576896:0:18895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324913 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755e9 expref: 11 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.576906:0:18895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.576949:0:18895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324913 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536755e9 expref: 11 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.576963:0:18895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324913 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536755e9 expref: 11 pid: 20097 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791856.576977:0:18895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18895:1875683630517504:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791856.582431:0:18895:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba862bf240 going to sleep for 11 seconds 00000100:00100000:3.0:1788791856.593671:0:18895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18895:1875683630517504:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791856.593702:0:18895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791856.605942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791856.615703:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606411776 00000100:00100000:3.0:1788791856.615719:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606411776 00010000:00010000:3.0:1788791856.615781:0:18881:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324913 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536755e9 expref: 12 pid: 20097 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791856.615898:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788791856.615908:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+12:2355:x1875683606411776:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791856.616262:0:18881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791856.616270:0:18881:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324913 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536755e9 expref: 12 pid: 20097 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.616301:0:18881:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324913 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536755e9 expref: 12 pid: 20097 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.616323:0:18881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324913 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536755e9 expref: 12 pid: 20097 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.616346:0:18881:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9abaa0613500) 00010000:00010000:3.0:1788791856.616351:0:18881:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.616361:0:18881:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.616369:0:18881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.616394:0:18881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791856.616446:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ab063e8-7e10-4fb9-9b7e-072e56167789+11:2355:x1875683606411776:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 540us (10513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791856.616454:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00010000:00010000:3.0:1788791856.616483:0:18895:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.616491:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.618320:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a324944 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.618365:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a324944 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791856.618376:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a324944 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.622368:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32494b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.622387:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32494b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.622400:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32494b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791856.622411:0:18895:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788791856.622440:0:18895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.622447:0:18895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.622462:0:18895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.622469:0:18895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791856.622473:0:18895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.622493:0:18895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.623636:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9abaa0613500) 00010000:00010000:2.0:1788791856.623643:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791856.623717:0:18895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.623726:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32493d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788791856.624362:0:18895:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000001772e6b4 reply state 000000008b356a5d transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a324944 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791856.624374:0:18895:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788791856.624426:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324936 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755f7 expref: 14 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.624444:0:18895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32494b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755f7 expref: 13 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.624452:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:2.0:1788791856.624468:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788791856.624471:0:18895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffc00, rc 0) 00000100:00100000:2.0:1788791856.625471:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+14:17395:x1875683606411648:12345-192.168.201.29@tcp:101:bash.0 Request processed in 48773us (49057us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788791856.625489:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00010000:00010000:0.0:1788791856.636176:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a324944 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.636195:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a324944 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.636204:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a324944 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.636239:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16de00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791856.636245:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a324944 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.636253:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a324944 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.636271:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9aba8823c400) 00010000:00010000:0.0:1788791856.636275:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791856.636279:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a324944 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791856.636285:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a324944 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791856.671360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791856.672352:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606411904 00000100:00100000:1.0:1788791856.672363:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606411904 00000100:00100000:1.0:1788791856.672430:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:1.0:1788791856.672440:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+13:17395:x1875683606411904:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788791856.672465:0:18897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791856.672486:0:18897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324959 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536755fe expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.672566:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c200/0xcd6380150a324960 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.672580:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c200/0xcd6380150a324960 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.672591:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c200/0xcd6380150a324960 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791856.672629:0:18897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788791856.672633:0:18897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791856.672665:0:18897:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c200/0xcd6380150a324960 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.672677:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c200/0xcd6380150a324960 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.672712:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324959 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755fe expref: 15 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.672733:0:18897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c200/0xcd6380150a324960 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755fe expref: 14 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791856.672742:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:1.0:1788791856.672745:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788791856.672749:0:18897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92c200, rc 0) 00000100:00100000:1.0:1788791856.673098:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+14:17395:x1875683606411904:12345-192.168.201.29@tcp:101:bash.0 Request processed in 658us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791856.673107:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1788791856.679164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791856.679250:0:18899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606412160 00000100:00100000:1.0:1788791856.679259:0:18899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606412160 00000100:00100000:1.0:1788791856.679313:0:18899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1788791856.679325:0:18899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+14:17395:x1875683606412160:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:1.0:1788791856.679677:0:18899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+15:17395:x1875683606412160:12345-192.168.201.29@tcp:35:bash.0 Request processed in 354us (556us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788791856.679686:0:18899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000040:00080000:3.0:1788791856.806368:0:18928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788791856.924267:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791856.927774:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606412416 00000100:00100000:2.0:1788791856.927798:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606412416 00000100:00100000:2.0:1788791856.927873:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:2.0:1788791856.927883:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+15:17405:x1875683606412416:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791856.927907:0:18895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791856.927924:0:18895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324967 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675605 expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791856.928040:0:18895:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788791856.928174:0:18895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324967 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675605 expref: 17 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.928190:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613700) 00010000:00010000:2.0:1788791856.928192:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791856.928197:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324967 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675605 expref: 17 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791856.928210:0:18895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffa00, rc 0) 00000100:00100000:2.0:1788791856.928279:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+16:17405:x1875683606412416:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 397us (4021us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1788791856.928287:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:1.0:1788791856.931575:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630517632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791856.931641:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791856.931776:0:19585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630517632 00000100:00100000:0.0:1788791856.931784:0:19585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630517632 00000100:00100000:0.0:1788791856.931853:0:19585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788791856.931863:0:19585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630517632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791856.931894:0:19585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788791856.931943:0:19585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630517632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791856.931950:0:19585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788791856.932112:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791856.932166:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630517632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791856.935996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791856.936158:0:18899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606412672 00000100:00100000:1.0:1788791856.936167:0:18899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606412672 00000100:00100000:1.0:1788791856.936234:0:18899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:1.0:1788791856.936244:0:18899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+16:17405:x1875683606412672:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791856.936492:0:18899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+17:17405:x1875683606412672:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 249us (504us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788791856.936500:0:18899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1788791857.006170:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791857.006369:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606412928 00000100:00100000:3.0:1788791857.006380:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606412928 00000100:00100000:3.0:1788791857.006438:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:3.0:1788791857.006456:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+17:17408:x1875683606412928:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788791857.006482:0:20097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791857.006511:0:20097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a324975 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367560c expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791857.006606:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a32497c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791857.006619:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a32497c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791857.006631:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a32497c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791857.006642:0:20097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788791857.006762:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a324975 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367560c expref: 20 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791857.006800:0:20097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a32497c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367560c expref: 19 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791857.006809:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:3.0:1788791857.006812:0:20097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788791857.006815:0:20097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c200, rc 0) 00000100:00100000:3.0:1788791857.006877:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+19:17408:x1875683606412928:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 430us (759us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788791857.006884:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:2.0:1788791857.016026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791857.016076:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791857.016351:0:18882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606413184 00000100:00100000:0.0:1788791857.016362:0:18882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606413184 00000100:00100000:0.0:1788791857.016448:0:18882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1788791857.016459:0:18882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+19:2353:x1875683606413184:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791857.016475:0:18882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791857.016499:0:18882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a32497c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367560c expref: 19 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791857.016517:0:18882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:0.0:1788791857.016522:0:18882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791857.016580:0:18882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+18:2353:x1875683606413184:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 123us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791857.016588:0:18882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:1.0:1788791857.016805:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606413056 00000100:00100000:1.0:1788791857.016810:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606413056 00000100:00100000:1.0:1788791857.016850:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:1.0:1788791857.016858:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+18:17408:x1875683606413056:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:1.0:1788791857.016908:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32498a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.016922:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32498a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.016931:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32498a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.016955:0:18896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32498a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.016961:0:18896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32498a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.016967:0:18896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32498a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.016973:0:18896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92c800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791857.016978:0:18896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32498a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.016995:0:18896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32498a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.017004:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:1.0:1788791857.017006:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788791857.017010:0:18896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32498a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.017017:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32498a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791857.017051:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+18:17408:x1875683606413056:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 195us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791857.017057:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:0.0:1788791857.023499:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791857.024911:0:18899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606413440 00000100:00100000:1.0:1788791857.024923:0:18899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606413440 00000100:00100000:1.0:1788791857.024992:0:18899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788791857.025004:0:18899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+18:17408:x1875683606413440:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791857.025303:0:18899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+19:17408:x1875683606413440:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 300us (1811us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788791857.025311:0:18899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00010000:00010000:0.0:1788791857.509929:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791857.605726:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791857.606189:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606413696 00000100:00100000:1.0:1788791857.606199:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606413696 00000100:00100000:1.0:1788791857.606264:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1788791857.606275:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+19:17440:x1875683606413696:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:1.0:1788791857.606299:0:20097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791857.606330:0:20097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324991 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675613 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.606443:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324998 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.606456:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324998 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.606467:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324998 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791857.606476:0:20097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788791857.606601:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324991 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675613 expref: 22 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.606619:0:20097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324998 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675613 expref: 21 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.606627:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:1.0:1788791857.606629:0:20097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788791857.606633:0:20097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92c400, rc 0) 00000100:00100000:1.0:1788791857.606695:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+21:17440:x1875683606413696:12345-192.168.201.29@tcp:101:cat.0 Request processed in 422us (980us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788791857.606702:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:2.0:1788791857.615612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791857.615695:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791857.615799:0:21010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606414080 00000100:00100000:0.0:1788791857.615809:0:21010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606414080 00000100:00100000:0.0:1788791857.615877:0:21010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:0.0:1788791857.615889:0:21010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+21:2355:x1875683606414080:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791857.615906:0:21010:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791857.615931:0:21010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324998 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675613 expref: 21 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791857.615951:0:21010:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:0.0:1788791857.615957:0:21010:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791857.616019:0:21010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+20:2355:x1875683606414080:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 131us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791857.616026:0:21010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:3.0:1788791857.620913:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606413952 00000100:00100000:3.0:1788791857.620927:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606413952 00000100:00100000:3.0:1788791857.620996:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1788791857.621007:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+20:17440:x1875683606413952:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:3.0:1788791857.621389:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+21:17440:x1875683606413952:12345-192.168.201.29@tcp:35:cat.0 Request processed in 383us (5785us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788791857.621397:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1788791857.738447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791857.738569:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606414336 00000100:00100000:1.0:1788791857.738579:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606414336 00000100:00100000:1.0:1788791857.738636:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:1.0:1788791857.738646:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+21:17446:x1875683606414336:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:1.0:1788791857.738668:0:18896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791857.738701:0:18896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a3249a6 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367561a expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.738800:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249ad lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.738815:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249ad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.738829:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249ad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791857.738840:0:18896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788791857.738990:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a3249a6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367561a expref: 24 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.739009:0:18896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249ad lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367561a expref: 23 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.739018:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:1.0:1788791857.739021:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788791857.739025:0:18896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92dc00, rc 0) 00000100:00100000:1.0:1788791857.739091:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+23:17446:x1875683606414336:12345-192.168.201.29@tcp:101:dd.0 Request processed in 446us (654us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1788791857.739097:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:2.0:1788791857.742165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791857.742952:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606414592 00000100:00100000:1.0:1788791857.742963:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606414592 00000100:00100000:1.0:1788791857.743025:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:1.0:1788791857.743035:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+23:17446:x1875683606414592:12345-192.168.201.29@tcp:36:dd.0 00010000:00010000:1.0:1788791857.743103:0:20097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788791857.743173:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249ad lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367561a expref: 23 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.743195:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c200/0xcd6380150a324960 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755fe expref: 22 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.743206:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:1.0:1788791857.743211:0:20097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791857.743421:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249bb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.743434:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249bb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791857.743443:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249bb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788791857.743493:0:20097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1788791857.743524:0:20097:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000f531ace5 reply state 000000007c9dfb60 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249bb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791857.743534:0:20097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788791857.743634:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+24:17446:x1875683606414592:12345-192.168.201.29@tcp:36:dd.0 Request processed in 599us (1477us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1788791857.743641:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000020:00080000:1.0:1788791857.743646:0:20097:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788791857.745078:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249bb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791857.745092:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249bb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791857.745099:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249bb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791857.745105:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92de00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791857.745109:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249bb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791857.745115:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249bb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791857.745269:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:2.0:1788791857.745273:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791857.745278:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249bb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791857.745284:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249bb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791857.918087:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791857.918647:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606414848 00000100:00100000:3.0:1788791857.918658:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606414848 00000100:00100000:3.0:1788791857.918718:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1788791857.918728:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+23:17446:x1875683606414848:12345-192.168.201.29@tcp:35:dd.0 00000100:00100000:3.0:1788791857.919073:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+24:17446:x1875683606414848:12345-192.168.201.29@tcp:35:dd.0 Request processed in 345us (994us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1788791857.919081:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1788791858.164909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791858.165079:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606414976 00000100:00100000:1.0:1788791858.165090:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606414976 00000100:00100000:1.0:1788791858.165220:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:1.0:1788791858.165245:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+24:17460:x1875683606414976:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:1.0:1788791858.165269:0:18896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791858.165291:0:18896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c200/0xcd6380150a3249c2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675621 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165383:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249c9 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165398:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249c9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165410:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249c9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165426:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a3249d0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165434:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a3249d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165442:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a3249d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165542:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249d7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165551:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165558:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791858.165600:0:18896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788791858.165604:0:18896:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791858.165642:0:18896:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165655:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165662:0:18896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249c9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165669:0:18896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249c9 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165676:0:18896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249c9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165682:0:18896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92dc00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791858.165686:0:18896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249c9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165693:0:18896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249c9 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165706:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9abaa0613500) 00010000:00010000:1.0:1788791858.165709:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791858.165714:0:18896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249c9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165720:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a3249c9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165742:0:18896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a3249d0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165749:0:18896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a3249d0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165754:0:18896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a3249d0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165758:0:18896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92c800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791858.165761:0:18896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a3249d0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165766:0:18896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a3249d0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165773:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9aba9010c300) 00010000:00010000:1.0:1788791858.165775:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791858.165777:0:18896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a3249d0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165782:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a3249d0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165812:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c200/0xcd6380150a3249c2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675621 expref: 26 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165825:0:18896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249d7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675621 expref: 25 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.165841:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:1.0:1788791858.165843:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788791858.165846:0:18896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92de00, rc 0) 00000100:00100000:1.0:1788791858.165914:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+25:17460:x1875683606414976:12345-192.168.201.29@tcp:101:stat.0 Request processed in 673us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791858.165921:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00080000:0.0:1788791858.166284:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791858.223325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791858.223381:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791858.223412:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791858.223445:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791858.223465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791858.223485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791858.223512:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606415360 00000100:00100000:2.0:1788791858.223521:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606415360 00000100:00100000:3.0:1788791858.223548:0:19583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606415616 00000100:00100000:3.0:1788791858.223553:0:19583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606415616 00000100:00100000:3.0:1788791858.223568:0:19583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606415232 00000100:00100000:2.0:1788791858.223569:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606415744 00000100:00100000:3.0:1788791858.223571:0:19583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606415232 00000100:00100000:2.0:1788791858.223571:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606415744 00000100:00100000:3.0:1788791858.223586:0:19583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1788791858.223595:0:19583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2352:x1875683606415360:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791858.223629:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606415104 00000100:00100000:0.0:1788791858.223634:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606415104 00000100:00100000:0.0:1788791858.223661:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:0.0:1788791858.223667:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+13:2352:x1875683606415104:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791858.223673:0:19583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2352:x1875683606415360:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 79us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791858.223768:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:083ef4df-491f-4201-9752-09108931e701+13:2352:x1875683606415104:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 100us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791858.223776:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:2.0:1788791858.228962:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:2.0:1788791858.228993:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6ab063e8-7e10-4fb9-9b7e-072e56167789+5:2352:x1875683606415616:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791858.229575:0:19583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1788791858.229617:0:19583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:3.0:1788791858.229688:0:19583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2352:x1875683606415232:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791858.229726:0:19583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2352:x1875683606415232:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 44us (6280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791858.229732:0:19583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:3.0:1788791858.229746:0:19583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:3.0:1788791858.229753:0:19583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6ab063e8-7e10-4fb9-9b7e-072e56167789+5:2352:x1875683606415744:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791858.229777:0:19583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6ab063e8-7e10-4fb9-9b7e-072e56167789+5:2352:x1875683606415744:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (6291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791858.229784:0:19583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:3.0:1788791858.229860:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791858.229998:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606415488 00000100:00100000:3.0:1788791858.230006:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606415488 00000100:00100000:3.0:1788791858.230050:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606416000 00000100:00100000:3.0:1788791858.230053:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606416000 00000100:00100000:3.0:1788791858.230074:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:3.0:1788791858.230094:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ab063e8-7e10-4fb9-9b7e-072e56167789+11:2352:x1875683606415488:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791858.230149:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6ab063e8-7e10-4fb9-9b7e-072e56167789+11:2352:x1875683606415488:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 34us (6662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791858.230156:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:3.0:1788791858.230170:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:3.0:1788791858.230176:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+25:17466:x1875683606416000:12345-192.168.201.29@tcp:36:truncate.0 00010000:00010000:3.0:1788791858.230216:0:18897:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791858.230243:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a3249d7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675621 expref: 25 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.230264:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:3.0:1788791858.230269:0:18897:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791858.230484:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3249de lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.230499:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3249de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.230605:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3249de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788791858.230744:0:18897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:3.0:1788791858.230773:0:18897:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000b754e021 reply state 00000000069640b0 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3249de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791858.230783:0:18897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788791858.230856:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+27:17466:x1875683606416000:12345-192.168.201.29@tcp:36:truncate.0 Request processed in 679us (996us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788791858.230871:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000020:00080000:3.0:1788791858.230875:0:18897:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788791858.232614:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6ab063e8-7e10-4fb9-9b7e-072e56167789+5:2352:x1875683606415616:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 3631us (9193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791858.232626:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00080000:2.0:1788791858.232660:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788791858.232666:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788791858.232669:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788791858.248735:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3249de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.248754:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3249de lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.248762:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3249de lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.248769:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16de00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791858.248774:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3249de lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.248781:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3249de lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.248799:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:0.0:1788791858.248802:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791858.248807:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3249de lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.248813:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3249de lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791858.435022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791858.435103:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606416128 00000100:00100000:3.0:1788791858.435112:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606416128 00000100:00100000:3.0:1788791858.435193:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:3.0:1788791858.435202:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+26:17480:x1875683606416128:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:3.0:1788791858.435224:0:18897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791858.435243:0:18897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3249e5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675628 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435298:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3249ec lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435322:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3249ec lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435334:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3249ec lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435358:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3249f3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435366:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3249f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435373:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3249f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435458:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3249fa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435482:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3249fa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435491:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3249fa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791858.435761:0:18897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1788791858.435766:0:18897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788791858.435789:0:18897:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3249fa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435801:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3249fa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435811:0:18897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3249ec lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435818:0:18897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3249ec lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435826:0:18897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3249ec lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435833:0:18897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791858.435837:0:18897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3249ec lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435845:0:18897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3249ec lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435857:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9abaa0613500) 00010000:00010000:3.0:1788791858.435866:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791858.435871:0:18897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3249ec lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435879:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3249ec lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435893:0:18897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3249f3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435900:0:18897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3249f3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435907:0:18897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3249f3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435913:0:18897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791858.435916:0:18897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3249f3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435923:0:18897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3249f3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435929:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9aba8823cb00) 00010000:00010000:3.0:1788791858.435932:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791858.435934:0:18897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3249f3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435940:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3249f3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435968:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3249e5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675628 expref: 28 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435991:0:18897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3249fa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675628 expref: 27 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.435999:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:3.0:1788791858.436002:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788791858.436004:0:18897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16da00, rc 0) 00000100:00100000:3.0:1788791858.436069:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+27:17480:x1875683606416128:12345-192.168.201.29@tcp:101:stat.0 Request processed in 868us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791858.436077:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00010000:00010000:2.0:1788791858.531383:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791858.564335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791858.564419:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606416384 00000100:00100000:0.0:1788791858.564427:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606416384 00000100:00100000:0.0:1788791858.564475:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:0.0:1788791858.564482:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+27:17490:x1875683606416384:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791858.564500:0:18895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791858.564626:0:18895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324a01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367562f expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791858.564731:0:18895:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788791858.564838:0:18895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324a01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367562f expref: 29 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.564851:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613700) 00010000:00010000:0.0:1788791858.564854:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788791858.564858:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324a01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367562f expref: 29 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.564870:0:18895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ab981c8d200, rc 0) 00000100:00100000:0.0:1788791858.564932:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+28:17490:x1875683606416384:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 449us (604us total) trans 12884901910 rc 301/301 00000100:00100000:0.0:1788791858.564938:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:0.0:1788791858.567205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791858.567262:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606416640 00000100:00100000:3.0:1788791858.567270:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606416640 00000100:00100000:3.0:1788791858.567320:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788791858.567329:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86391850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+28:17490:x1875683606416640:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:3.0:1788791858.567794:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86391850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+29:17490:x1875683606416640:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 464us (593us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1788791858.567802:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788791858.614827:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791858.615341:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606416896 00000100:00100000:1.0:1788791858.615351:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606416896 00000100:00100000:1.0:1788791858.615412:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:1.0:1788791858.615421:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+29:17496:x1875683606416896:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788791858.615446:0:18896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791858.615465:0:18896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c200/0xcd6380150a324a0f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675636 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.616714:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.616737:0:18896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32494b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536755f7 expref: 30 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.616745:0:18896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3249fa lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675628 expref: 30 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.616754:0:18896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.616793:0:18896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3249fa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675628 expref: 30 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.616824:0:18896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3249fa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675628 expref: 30 pid: 18897 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791858.616840:0:18896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18896:1875683630517760:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791858.619716:0:18896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32494b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536755f7 expref: 30 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.619736:0:18896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32494b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536755f7 expref: 30 pid: 18895 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791858.619752:0:18896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18896:1875683630517888:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791858.624482:0:18896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791858.632403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791858.632499:0:18882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606417024 00000100:00100000:1.0:1788791858.632511:0:18882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606417024 00010000:00010000:1.0:1788791858.632560:0:18882:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3249fa lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675628 expref: 31 pid: 18897 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791858.632604:0:18882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:1.0:1788791858.632614:0:18882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababab32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+31:2355:x1875683606417024:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791858.632628:0:18882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791858.632635:0:18882:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3249fa lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675628 expref: 31 pid: 18897 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.632660:0:18882:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3249fa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675628 expref: 31 pid: 18897 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.632706:0:18882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:1.0:1788791858.632711:0:18882:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.632719:0:18882:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.632725:0:18882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791858.632785:0:18882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababab32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+31:2355:x1875683606417024:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 172us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791858.632793:0:18882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1788791858.634749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:0.0:1788791858.635372:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3249fa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675628 expref: 30 pid: 18897 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791858.635417:0:18896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18896:1875683630517760:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791858.635434:0:18896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18896:1875683630517888:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791858.635461:0:18896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791858.636053:0:21010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606417152 00000100:00100000:3.0:1788791858.636061:0:21010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606417152 00010000:00010000:3.0:1788791858.636098:0:21010:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32494b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536755f7 expref: 30 pid: 18895 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791858.636177:0:21010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1788791858.636187:0:21010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+30:2355:x1875683606417152:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791858.636447:0:21010:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791858.636455:0:21010:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32494b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536755f7 expref: 30 pid: 18895 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.636467:0:21010:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32494b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536755f7 expref: 30 pid: 18895 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.636487:0:21010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32494b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536755f7 expref: 30 pid: 18895 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.636498:0:21010:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:3.0:1788791858.636503:0:21010:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.636685:0:21010:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.636692:0:21010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.636723:0:21010:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791858.636832:0:21010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+29:2355:x1875683606417152:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 646us (2094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791858.636840:0:21010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00010000:00010000:0.0:1788791858.638615:0:18896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.638630:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791858.638662:0:18896:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788791858.638833:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c200/0xcd6380150a324a0f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675636 expref: 30 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.638854:0:18896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675636 expref: 29 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.638862:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:0.0:1788791858.638865:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788791858.638868:0:18896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92c800, rc 0) 00000100:00100000:0.0:1788791858.638918:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+29:17496:x1875683606416896:12345-192.168.201.29@tcp:101:bash.0 Request processed in 23498us (24101us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1788791858.638926:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:3.0:1788791858.641589:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791858.641742:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606417408 00000100:00100000:0.0:1788791858.641753:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606417408 00000100:00100000:0.0:1788791858.641827:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:0.0:1788791858.641836:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+29:17496:x1875683606417408:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:0.0:1788791858.642099:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a24 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.642116:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a24 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.642291:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a24 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788791858.642355:0:18895:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:0.0:1788791858.642384:0:18895:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000002e6be3a7 reply state 00000000a5e1863a transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a24 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791858.642394:0:18895:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788791858.642477:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+32:17496:x1875683606417408:12345-192.168.201.29@tcp:36:bash.0 Request processed in 640us (968us total) trans 12884901914 rc 0/0 00000100:00100000:0.0:1788791858.642485:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000020:00080000:0.0:1788791858.642489:0:18895:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788791858.644853:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a24 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.644870:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a24 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.644903:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a24 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.644909:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8d600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791858.644914:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a24 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.644922:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a24 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.644939:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:3.0:1788791858.644942:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791858.644947:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a24 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.644954:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a24 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791858.645247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791858.645744:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606417536 00000100:00100000:3.0:1788791858.645754:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606417536 00000100:00100000:3.0:1788791858.645803:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:3.0:1788791858.645811:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+31:17496:x1875683606417536:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1788791858.645831:0:18897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791858.645846:0:18897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a324a2b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367563d expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.645904:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a324a2b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367563d expref: 32 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.645924:0:18897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a324a2b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367563d expref: 32 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791858.645940:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:3.0:1788791858.645942:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788791858.645944:0:18897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c400, rc 0) 00000100:00100000:3.0:1788791858.645994:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+32:17496:x1875683606417536:12345-192.168.201.29@tcp:101:bash.0 Request processed in 184us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791858.645999:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:2.0:1788791858.652027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791858.652206:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606417664 00000100:00100000:1.0:1788791858.652216:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606417664 00000100:00100000:1.0:1788791858.652327:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:1.0:1788791858.652338:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+32:17496:x1875683606417664:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788791858.652356:0:20097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791858.652375:0:20097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a32 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675644 expref: -99 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.652450:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a39 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.652465:0:20097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675636 expref: 33 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.652475:0:20097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a39 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.652709:0:20097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675636 expref: 33 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.652721:0:20097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675636 expref: 33 pid: 18896 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791858.652731:0:20097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20097:1875683630518016:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791858.652800:0:20097:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba995af3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791858.654910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791858.655055:0:20097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20097:1875683630518016:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791858.655081:0:20097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a39 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791858.655375:0:18882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606417792 00000100:00100000:0.0:1788791858.655381:0:18882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606417792 00010000:00010000:0.0:1788791858.655416:0:18882:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675636 expref: 34 pid: 18896 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791858.655494:0:18882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788791858.655819:0:18882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+34:2355:x1875683606417792:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791858.655835:0:18882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791858.655855:0:18882:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675636 expref: 34 pid: 18896 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.655867:0:18882:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675636 expref: 34 pid: 18896 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.655953:0:18882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a324a16 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675636 expref: 34 pid: 18896 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.655970:0:18882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:0.0:1788791858.655976:0:18882:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a39 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.655986:0:18882:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a39 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.655993:0:18882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a39 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.656062:0:18882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791858.656120:0:18882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+33:2355:x1875683606417792:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 616us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791858.656165:0:18882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00010000:00010000:1.0:1788791858.656415:0:20097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a39 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.656424:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a39 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791858.656481:0:20097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788791858.656485:0:20097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791858.656505:0:20097:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a39 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.656871:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a32 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675644 expref: 33 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.656888:0:20097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a39 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675644 expref: 32 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.656909:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:1.0:1788791858.656911:0:20097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788791858.656914:0:20097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92c400, rc 0) 00000100:00100000:1.0:1788791858.656943:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+32:17496:x1875683606417664:12345-192.168.201.29@tcp:101:bash.0 Request processed in 4607us (4926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791858.656949:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:0.0:1788791858.659466:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791858.659612:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606418048 00000100:00100000:1.0:1788791858.659621:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606418048 00000100:00100000:1.0:1788791858.659747:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:1.0:1788791858.659758:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+32:17496:x1875683606418048:12345-192.168.201.29@tcp:103:bash.0 00010000:00010000:1.0:1788791858.659773:0:18881:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788791858.659795:0:18881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a39 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675644 expref: 32 pid: 20097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.659812:0:18881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a324a2b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367563d expref: 31 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.659818:0:18881:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9aba8533ff00) 00010000:00010000:1.0:1788791858.659826:0:18881:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791858.659866:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+30:17496:x1875683606418048:12345-192.168.201.29@tcp:103:bash.0 Request processed in 110us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791858.659873:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1788791858.661178:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791858.661252:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606418176 00000100:00100000:0.0:1788791858.661258:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606418176 00000100:00100000:0.0:1788791858.661294:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:0.0:1788791858.661308:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+30:17496:x1875683606418176:12345-192.168.201.29@tcp:58:bash.0 00010000:00010000:0.0:1788791858.661399:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a324a40 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.661430:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a324a40 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.661440:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a324a40 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788791858.663846:0:18897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788791858.663968:0:18897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1788791858.664014:0:18897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1788791858.664146:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+30:17496:x1875683606418176:12345-192.168.201.29@tcp:58:bash.0 Request processed in 2823us (2952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791858.664155:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:2.0:1788791858.666785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791858.667149:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606418304 00000100:00100000:0.0:1788791858.667158:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606418304 00000100:00100000:0.0:1788791858.667198:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:0.0:1788791858.667204:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+30:17496:x1875683606418304:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788791858.667220:0:18895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791858.667236:0:18895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a324a47 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367564b expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.667281:0:18895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a324a40 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.667288:0:18895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a324a47 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367564b expref: 31 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.667319:0:18895:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a324a40 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.667344:0:18895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a324a47 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367564b expref: 31 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.667357:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:0.0:1788791858.667361:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788791858.667377:0:18895:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a324a47 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367564b expref: 31 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.667385:0:18895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ab981c8d400, rc 0) 00000100:00100000:0.0:1788791858.667486:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+31:17496:x1875683606418304:12345-192.168.201.29@tcp:101:bash.0 Request processed in 280us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791858.667492:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000040:00080000:2.0:1788791858.856081:0:18928:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788791858.856093:0:18928:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788791858.856152:0:18928:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788791858.856158:0:18928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788791858.856292:0:18928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18928:1875683630518144:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788791858.856655:0:18928:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba862bf900 going to sleep for 11 seconds 00000100:00100000:0.0:1788791858.863045:0:18928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18928:1875683630518144:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788791858.865417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791858.865712:0:18906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606418432 00000100:00100000:1.0:1788791858.865722:0:18906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606418432 00000100:00100000:1.0:1788791858.865778:0:18906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:1.0:1788791858.865789:0:18906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+31:17497:x1875683606418432:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788791858.865894:0:18906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+31:17497:x1875683606418432:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 Request processed in 106us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791858.865904:0:18906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1788791858.896225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791858.897325:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606418560 00000100:00100000:3.0:1788791858.897339:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606418560 00000100:00100000:3.0:1788791858.897416:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:3.0:1788791858.897429:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+31:17497:x1875683606418560:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788791858.897461:0:18896:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788791858.898148:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+31:17497:x1875683606418560:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 703us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791858.898158:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:3.0:1788791858.926712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791858.942713:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606418688 00000100:00100000:0.0:1788791858.942740:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606418688 00000100:00100000:0.0:1788791858.942816:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:0.0:1788791858.942828:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+31:17497:x1875683606418688:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788791858.942920:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a4e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.942935:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.942947:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.942971:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324a55 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.942979:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324a55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.943000:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324a55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.943034:0:18895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324a5c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.943042:0:18895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324a5c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.943049:0:18895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324a5c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791858.943096:0:18895:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788791858.943101:0:18895:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791858.943115:0:18895:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324a5c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947682:0:18895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947700:0:18895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a4e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947709:0:18895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a4e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947715:0:18895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8d600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791858.947721:0:18895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a4e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947730:0:18895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a4e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947769:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9abaa0613400) 00010000:00010000:0.0:1788791858.947772:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791858.947777:0:18895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a4e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947783:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324a4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947812:0:18895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324a55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947819:0:18895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324a55 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947824:0:18895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324a55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947829:0:18895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8d200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791858.947832:0:18895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324a55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947837:0:18895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324a55 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947845:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9abaa0613100) 00010000:00010000:0.0:1788791858.947848:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791858.947850:0:18895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324a55 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947856:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324a55 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947884:0:18895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324a5c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947890:0:18895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324a5c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947895:0:18895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324a5c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947899:0:18895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8ce00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791858.947902:0:18895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324a5c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947906:0:18895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324a5c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947912:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:0.0:1788791858.947914:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791858.947917:0:18895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324a5c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791858.947922:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324a5c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18895 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791858.948025:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+31:17497:x1875683606418688:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 5194us (21317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791858.948036:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:3.0:1788791858.957287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791858.957456:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606418944 00000100:00100000:1.0:1788791858.957467:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606418944 00000100:00100000:1.0:1788791858.957526:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:1.0:1788791858.957536:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+31:17497:x1875683606418944:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788791858.957559:0:18897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791858.957580:0:18897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675652 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.957676:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a6a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.957693:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.957705:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791858.957716:0:18897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788791858.957835:0:18897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a6a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.957844:0:18897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a6a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.957850:0:18897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a6a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.957857:0:18897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92dc00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791858.957861:0:18897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a6a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.957869:0:18897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a6a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.957883:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:1.0:1788791858.957886:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791858.957891:0:18897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a6a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.957897:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a6a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.957938:0:18897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a63 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675652 expref: 33 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.957950:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9abaa0613400) 00010000:00010000:1.0:1788791858.957952:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788791858.957955:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675652 expref: 33 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.957976:0:18897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92c400, rc 0) 00000100:00100000:1.0:1788791858.958041:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+32:17497:x1875683606418944:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 506us (764us total) trans 12884901915 rc 301/301 00000100:00100000:1.0:1788791858.958049:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:3.0:1788791858.965743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791858.965956:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606419072 00000100:00100000:1.0:1788791858.965966:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606419072 00000100:00100000:1.0:1788791858.966034:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:1.0:1788791858.966048:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+32:17497:x1875683606419072:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788791858.966096:0:20097:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788791858.966254:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+32:17497:x1875683606419072:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 210us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791858.966262:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:3.0:1788791858.972556:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791858.972790:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606419328 00000100:00100000:0.0:1788791858.972802:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606419328 00000100:00100000:0.0:1788791858.972881:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:0.0:1788791858.972904:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+32:17497:x1875683606419328:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791858.972924:0:18896:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791858.972944:0:18896:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324a78 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675659 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788791858.975924:0:18896:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x23:0x0], count =31 00000004:00080000:1.0:1788791858.975934:0:18896:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x23:0x0]+31 in llog 00000004:00080000:1.0:1788791858.975987:0:18896:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:1.0:1788791858.976545:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a7f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.976563:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a7f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.976576:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a7f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.977567:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324a78 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675659 expref: 35 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.978311:0:18896:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a7f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675659 expref: 34 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.978325:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9aba9010c300) 00010000:00010000:1.0:1788791858.978328:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788791858.978333:0:18896:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92c400, rc 0) 00000100:00100000:1.0:1788791858.978551:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+34:17497:x1875683606419328:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 5646us (6002us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788791858.978560:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:3.0:1788791858.996667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791858.996861:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606419584 00000100:00100000:1.0:1788791858.996872:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606419584 00000100:00100000:1.0:1788791858.996934:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:1.0:1788791858.996944:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+34:17497:x1875683606419584:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788791858.997003:0:20097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791858.997030:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324a7f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675659 expref: 34 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997052:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9aba9010c300) 00010000:00010000:1.0:1788791858.997063:0:20097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791858.997085:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a8d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997098:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a8d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997108:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a8d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997192:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324a94 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x70c2079a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997201:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324a94 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x70c2079a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997208:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324a94 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x70c2079a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997283:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a8d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997292:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a8d lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997311:0:20097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a8d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997317:0:20097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92dc00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791858.997321:0:20097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a8d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997329:0:20097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a8d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997338:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9abaa0613500) 00010000:00010000:1.0:1788791858.997341:0:20097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791858.997344:0:20097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a8d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997350:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324a8d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997367:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324a94 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x70c2079a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997373:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324a94 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x70c2079a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997380:0:20097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324a94 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x70c2079a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997385:0:20097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92d600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791858.997388:0:20097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324a94 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x70c2079a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997394:0:20097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324a94 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x70c2079a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997401:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x70c2079a (ffff9aba9010ce00) 00010000:00010000:1.0:1788791858.997403:0:20097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791858.997406:0:20097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324a94 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x70c2079a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791858.997412:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324a94 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x70c2079a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791858.997515:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+33:17497:x1875683606419584:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 572us (858us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788791858.997523:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:2.0:1788791859.000453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791859.000521:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606419712 00000100:00100000:3.0:1788791859.000542:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606419712 00000100:00100000:3.0:1788791859.000599:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:3.0:1788791859.000618:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+33:17497:x1875683606419712:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788791859.000653:0:18897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791859.000678:0:18897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a324a9b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675660 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.000715:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a324aa2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.000728:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a324aa2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.000740:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a324aa2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.000837:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a324a9b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675660 expref: 35 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.000859:0:18897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a324aa2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675660 expref: 34 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.000868:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9aba8823cb00) 00010000:00010000:3.0:1788791859.000871:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788791859.000875:0:18897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d000, rc 0) 00000100:00100000:3.0:1788791859.000953:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+34:17497:x1875683606419712:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 345us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791859.000960:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:3.0:1788791859.015799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.019482:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606419968 00000100:00100000:1.0:1788791859.019499:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606419968 00000100:00100000:1.0:1788791859.019574:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:1.0:1788791859.019601:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+34:17497:x1875683606419968:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788791859.019704:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324aa9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.019721:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324aa9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.019733:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324aa9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788791859.020211:0:20097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1788791859.020222:0:20097:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 635400094630ns, next at 636400092335ns, rc = 0 00000004:00010000:1.0:1788791859.020322:0:20097:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000009806920c reply state 00000000e8bfbc1c transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324aa9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791859.020332:0:20097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788791859.020442:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+36:17497:x1875683606419968:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 843us (4653us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1788791859.020450:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00010000:00010000:0.0:1788791859.023421:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324aa9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.023438:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324aa9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.023445:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324aa9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.023451:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92d600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791859.023456:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324aa9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.023464:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324aa9 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.023481:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9aba8823cb00) 00010000:00010000:0.0:1788791859.023484:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788791859.023489:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324aa9 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.023495:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d600/0xcd6380150a324aa9 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791859.034983:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.035901:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606420096 00000100:00100000:1.0:1788791859.035912:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606420096 00000100:00100000:1.0:1788791859.035977:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:1.0:1788791859.035987:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+35:17497:x1875683606420096:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788791859.036011:0:18897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791859.036030:0:18897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324ab0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675667 expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.036089:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324ab0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675667 expref: 36 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.036123:0:18897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324ab0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675667 expref: 36 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.036201:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9aba8823cb00) 00010000:00010000:1.0:1788791859.036205:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788791859.036208:0:18897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92dc00, rc 0) 00000100:00100000:1.0:1788791859.036265:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+36:17497:x1875683606420096:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 279us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.036273:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:2.0:1788791859.051655:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791859.051742:0:19583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606420224 00000100:00100000:3.0:1788791859.051768:0:19583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606420224 00000100:00100000:3.0:1788791859.051826:0:19583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1788791859.051836:0:19583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+5:2355:x1875683606420224:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788791859.052212:0:19583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2355:x1875683606420224:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 376us (565us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788791859.052220:0:19583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788791859.074681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791859.074784:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606420480 00000100:00100000:3.0:1788791859.074795:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606420480 00000100:00100000:3.0:1788791859.074861:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788791859.074871:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+36:17497:x1875683606420480:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788791859.075100:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+37:17497:x1875683606420480:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 230us (428us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1788791859.075108:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1788791859.077788:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.077882:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606420736 00000100:00100000:1.0:1788791859.077893:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606420736 00000100:00100000:1.0:1788791859.077947:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:1.0:1788791859.077957:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+37:17497:x1875683606420736:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788791859.078058:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+37:17497:x1875683606420736:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 102us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.078065:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:2.0:1788791859.101623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.102054:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606420864 00000100:00100000:1.0:1788791859.102066:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606420864 00000100:00100000:1.0:1788791859.102174:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:1.0:1788791859.102185:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+37:17497:x1875683606420864:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788791859.102206:0:18897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791859.102226:0:18897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324ab7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367566e expref: -99 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.102331:0:18897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324abe lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.102351:0:18897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324abe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.102361:0:18897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324abe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791859.102397:0:18897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791859.102416:0:18897:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324abe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.102443:0:18897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324ab7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367566e expref: 39 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.102473:0:18897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324abe lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367566e expref: 38 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.102482:0:18897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9aba8823cb00) 00010000:00010000:1.0:1788791859.102485:0:18897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788791859.102489:0:18897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92cc00, rc 0) 00000100:00100000:1.0:1788791859.102550:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+38:17497:x1875683606420864:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 366us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.102557:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:3.0:1788791859.109595:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.109843:0:20203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606420992 00000100:00100000:1.0:1788791859.109853:0:20203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606420992 00000100:00100000:1.0:1788791859.109915:0:20203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1788791859.109925:0:20203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2352:x1875683606420992:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788791859.109944:0:20203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791859.109979:0:20203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ac5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675675 expref: -99 pid: 20203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788791859.110006:0:20203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ecc33, blocks: 0x1 00010000:00010000:1.0:1788791859.110026:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=635s v=(0 0) 00010000:00010000:1.0:1788791859.110031:0:20203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791859.110041:0:20203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ac5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675675 expref: 7 pid: 20203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.110061:0:20203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ac5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675675 expref: 7 pid: 20203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.110076:0:20203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92c000, rc 0) 00000100:00100000:1.0:1788791859.110162:0:20203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:2352:x1875683606420992:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 237us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.110171:0:20203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1788791859.120932:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.121029:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606421248 00000100:00100000:1.0:1788791859.121039:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606421248 00000100:00100000:1.0:1788791859.121099:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:1.0:1788791859.121109:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+38:17497:x1875683606421248:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788791859.121248:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+38:17497:x1875683606421248:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 140us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.121255:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:3.0:1788791859.124098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.124321:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606421376 00000100:00100000:1.0:1788791859.124332:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606421376 00000100:00100000:1.0:1788791859.124391:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:1.0:1788791859.124401:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+38:17497:x1875683606421376:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788791859.270979:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901914 is committed 00000001:00080000:1.0:1788791859.271009:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901893 is committed 00000001:00080000:1.0:1788791859.271024:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901917 is committed 00000004:00080000:1.0:1788791859.271029:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788791859.271077:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901894 is committed 00000001:00080000:1.0:1788791859.271089:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000001:00080000:1.0:1788791859.271107:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:2.0:1788791859.271355:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+13:17497:x1875683606421376:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 146949us (147260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791859.271366:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:1.0:1788791859.271647:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab7987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630518272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788791859.271698:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791859.271978:0:19583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630518272 00000100:00100000:3.0:1788791859.271986:0:19583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630518272 00000100:00100000:3.0:1788791859.272042:0:19583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788791859.272051:0:19583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630518272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788791859.272226:0:19583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788791859.272230:0:19583:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788791859.272233:0:19583:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788791859.272235:0:19583:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788791859 -> 1788791859 00002000:00010000:3.0:1788791859.272237:0:19583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788791859.272271:0:19583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630518272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 221us (573us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1788791859.272289:0:19583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788791859.272357:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788791859.272522:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9abab7987b80/2, rc 0, transno 12884901891 00000100:00100000:0.0:1788791859.272535:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab7987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630518272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788791859.276736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.276840:0:20203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606421504 00000100:00100000:1.0:1788791859.276850:0:20203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606421504 00000100:00100000:1.0:1788791859.276905:0:20203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1788791859.276914:0:20203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:2354:x1875683606421504:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788791859.277016:0:20203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:2354:x1875683606421504:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 102us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.277025:0:20203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:0.0:1788791859.294222:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.300056:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606421760 00000100:00100000:1.0:1788791859.300070:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606421760 00000100:00100000:1.0:1788791859.300148:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:1.0:1788791859.300159:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+13:17497:x1875683606421760:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788791859.300208:0:20097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791859.300234:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324abe lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367566e expref: 13 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.300253:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9aba8823cb00) 00010000:00010000:1.0:1788791859.300258:0:20097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791859.300326:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324acc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.300339:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324acc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.300349:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324acc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788791859.300590:0:20097:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000007aad5d21 reply state 00000000380b3e1c transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324acc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791859.300600:0:20097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788791859.300699:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+14:17497:x1875683606421760:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 541us (6485us total) trans 12884901919 rc 0/0 00000100:00100000:1.0:1788791859.300707:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00010000:00010000:0.0:1788791859.306044:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324acc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.306062:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324acc lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.306070:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324acc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.306075:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791859.306081:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324acc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.306088:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324acc lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.306104:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9aba8823cb00) 00010000:00010000:0.0:1788791859.306108:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791859.306113:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324acc lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.306120:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c400/0xcd6380150a324acc lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791859.307767:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791859.307838:0:19583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606421888 00000100:00100000:3.0:1788791859.307848:0:19583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606421888 00000100:00100000:3.0:1788791859.307911:0:19583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1788791859.307921:0:19583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:17497:x1875683606421888:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788791859.307939:0:19583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791859.307957:0:19583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324ad3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367567c expref: -99 pid: 19583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.307987:0:19583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ac5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675675 expref: 8 pid: 20203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.307995:0:19583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791859.308000:0:19583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791859.308005:0:19583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324ad3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367567c expref: 8 pid: 19583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.308038:0:19583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ac5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675675 expref: 8 pid: 20203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.308054:0:19583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ac5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675675 expref: 8 pid: 20203 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791859.308068:0:19583:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:19583:1875683630518400:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791859.308203:0:19583:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791859.313873:0:19583:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:19583:1875683630518400:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791859.313907:0:19583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324ad3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367567c expref: 8 pid: 19583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.313947:0:19583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d400, rc 0) 00000100:00100000:0.0:1788791859.314007:0:19583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+8:17497:x1875683606421888:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 6087us (6247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791859.314016:0:19583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788791859.319415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.320552:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606422016 00000100:00100000:1.0:1788791859.320565:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606422016 00010000:00010000:1.0:1788791859.320610:0:18880:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ac5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675675 expref: 8 pid: 20203 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791859.320653:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:1.0:1788791859.320663:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+8:2354:x1875683606422016:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791859.320676:0:18880:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791859.320699:0:18880:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ac5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675675 expref: 8 pid: 20203 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.320714:0:18880:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ac5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675675 expref: 8 pid: 20203 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.320755:0:18880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ac5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675675 expref: 8 pid: 20203 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.320773:0:18880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791859.320778:0:18880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791859.320784:0:18880:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367567c expref: 7 pid: 19583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.320794:0:18880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367567c expref: 7 pid: 19583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.320829:0:18880:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367567c expref: 7 pid: 19583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791859.320842:0:18880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:18880:1875683630518528:192.168.201.29@tcp:105: 00000100:00100000:1.0:1788791859.320924:0:18880:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba862bf180 going to sleep for 11 seconds 00000100:00100000:1.0:1788791859.329938:0:18880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:18880:1875683630518528:192.168.201.29@tcp:105: 00010000:00010000:1.0:1788791859.329963:0:18880:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791859.330021:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:2354:x1875683606422016:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 9359us (10616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.330031:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1788791859.331661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791859.331798:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606422144 00000100:00100000:0.0:1788791859.331808:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606422144 00000100:00100000:0.0:1788791859.331876:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788791859.331887:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:2355:x1875683606422144:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788791859.332109:0:19582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788791859.332113:0:19582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788791858 00002000:00010000:0.0:1788791859.332116:0:19582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788791856 00002000:00010000:0.0:1788791859.332119:0:19582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788791859 -> 1788791858 00002000:00010000:0.0:1788791859.332121:0:19582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788791859.332213:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+8:2355:x1875683606422144:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 326us (557us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788791859.332221:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788791859.339630:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.339741:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606422272 00000100:00100000:1.0:1788791859.339751:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606422272 00000100:00100000:1.0:1788791859.339807:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:1.0:1788791859.339830:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+8:2354:x1875683606422272:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788791859.339887:0:19580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.339907:0:19580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324ad3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367567c expref: 8 pid: 19583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.339916:0:19580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791859.339921:0:19580:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788791859.339925:0:19580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 4/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.339959:0:19580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324ad3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367567c expref: 8 pid: 19583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.339974:0:19580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324ad3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367567c expref: 8 pid: 19583 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791859.339987:0:19580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19580:1875683630518656:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791859.340070:0:19580:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba862bf180 going to sleep for 11 seconds 00000100:00100000:3.0:1788791859.345474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791859.345648:0:21010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606422400 00000100:00100000:0.0:1788791859.345659:0:21010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606422400 00010000:00010000:0.0:1788791859.345702:0:21010:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324ad3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367567c expref: 9 pid: 19583 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791859.345748:0:21010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:0.0:1788791859.345770:0:21010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+9:2355:x1875683606422400:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791859.345786:0:21010:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791859.345812:0:21010:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324ad3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367567c expref: 9 pid: 19583 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.345826:0:21010:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324ad3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367567c expref: 9 pid: 19583 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.345856:0:21010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788791859.345860:0:21010:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788791859.345876:0:21010:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.345886:0:21010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.345908:0:21010:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791859.345967:0:21010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+9:2355:x1875683606422400:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 198us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791859.345974:0:21010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00010000:00010000:1.0:1788791859.346301:0:19580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324ad3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367567c expref: 8 pid: 19583 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791859.346319:0:19580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19580:1875683630518656:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791859.346344:0:19580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.346363:0:19580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.346369:0:19580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.346391:0:19580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.346400:0:19580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.346407:0:19580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.346413:0:19580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92c000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791859.346418:0:19580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.346426:0:19580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.346438:0:19580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.346457:0:19580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071c88099/0xcd6380150a324ada lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791859.346527:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:2354:x1875683606422272:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 6698us (6906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.346534:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1788791859.363925:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791859.364124:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606422656 00000100:00100000:0.0:1788791859.364186:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606422656 00000100:00100000:0.0:1788791859.364252:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:0.0:1788791859.364264:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+13:17497:x1875683606422656:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788791859.364360:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324ae1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.364393:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324ae1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.364405:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324ae1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.364678:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.364690:0:18896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324ab0 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675667 expref: 14 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.364699:0:18896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.364732:0:18896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324ab0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675667 expref: 14 pid: 18897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.364746:0:18896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324ab0 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675667 expref: 14 pid: 18897 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791859.364760:0:18896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18896:1875683630518784:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791859.364850:0:18896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788791859.368595:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.368752:0:18882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606422784 00000100:00100000:1.0:1788791859.368761:0:18882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606422784 00010000:00010000:1.0:1788791859.368802:0:18882:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324ab0 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675667 expref: 15 pid: 18897 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791859.368847:0:18882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1788791859.368857:0:18882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+15:2354:x1875683606422784:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791859.368874:0:18882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791859.368881:0:18882:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324ab0 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675667 expref: 15 pid: 18897 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.368894:0:18882:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324ab0 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675667 expref: 15 pid: 18897 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.368916:0:18882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9aba8823cb00) 00010000:00010000:1.0:1788791859.368921:0:18882:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.368932:0:18882:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.368952:0:18882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.368971:0:18882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791859.369029:0:18882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+15:2354:x1875683606422784:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 173us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.369038:0:18882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00010000:00010000:0.0:1788791859.375864:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324ab0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675667 expref: 14 pid: 18897 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791859.375893:0:18896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18896:1875683630518784:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791859.375920:0:18896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.375950:0:18896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.375955:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788791859.376234:0:18896:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:0.0:1788791859.376404:0:18896:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:0.0:1788791859.376449:0:18896:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:0.0:1788791859.376534:0:18896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18896:1875683630518912:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788791859.376596:0:18896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791859.376623:0:18896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082900 going to sleep for 11 seconds 00000100:00100000:1.0:1788791859.376792:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630518912 00000100:00100000:1.0:1788791859.376801:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630518912 00000100:00100000:1.0:1788791859.376855:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788791859.376864:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18896:x1875683630518912:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788791859.376949:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18896:x1875683630518912:12345-0@lo:1000:mdt00_001.0 Request processed in 85us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.376956:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788791859.378002:0:18896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18896:1875683630518912:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788791859.378726:0:18896:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:3.0:1788791859.378794:0:18896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18896:1875683630519040:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788791859.378842:0:18896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791859.378861:0:18896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba856d3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788791859.379115:0:18900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630519040 00000100:00100000:1.0:1788791859.379122:0:18900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630519040 00000100:00100000:1.0:1788791859.379197:0:18900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788791859.379207:0:18900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18896:x1875683630519040:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788791859.379383:0:18900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:18896:x1875683630519040:12345-0@lo:1000:mdt00_001.0 Request processed in 176us (539us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788791859.379390:0:18900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791859.382986:0:18896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18896:1875683630519040:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788791859.383040:0:18896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383051:0:18896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383059:0:18896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383065:0:18896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8d200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791859.383070:0:18896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383078:0:18896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383095:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9aba8823cb00) 00010000:00010000:3.0:1788791859.383099:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788791859.383120:0:18896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383170:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d200/0xcd6380150a324ae8 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383207:0:18896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a324a40 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383213:0:18896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a324a40 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383223:0:18896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a324a40 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383228:0:18896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8c000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791859.383231:0:18896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a324a40 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383237:0:18896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a324a40 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383245:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:3.0:1788791859.383247:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788791859.383254:0:18896:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a324a47 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367564b expref: 17 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383265:0:18896:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a324a47 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367564b expref: 17 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383274:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a324a47 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367564b expref: 17 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791859.383331:0:18896:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d400/0xcd6380150a324a47 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367564b expref: 17 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791859.383344:0:18896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85783480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18896:1875683630519168:192.168.201.29@tcp:105: 00000100:00100000:3.0:1788791859.383429:0:18896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba829ced80 going to sleep for 11 seconds 00000100:00100000:3.0:1788791859.397696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.398066:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606422912 00000100:00100000:1.0:1788791859.398077:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606422912 00000100:00100000:1.0:1788791859.398184:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1788791859.398195:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+18:17496:x1875683606422912:12345-192.168.201.29@tcp:49:bash.0 00000100:00100000:1.0:1788791859.398337:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+18:17496:x1875683606422912:12345-192.168.201.29@tcp:49:bash.0 Request processed in 143us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.398358:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:0.0:1788791859.398576:0:18896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85783480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18896:1875683630519168:192.168.201.29@tcp:105: 00010000:00010000:0.0:1788791859.398603:0:18896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a324a40 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398615:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8c000/0xcd6380150a324a40 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398645:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324aef lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398659:0:18896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324aef lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398670:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324aef lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398680:0:18896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324aef lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398698:0:18896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324aef lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398705:0:18896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324aef lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398711:0:18896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8ce00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791859.398716:0:18896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324aef lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398723:0:18896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324aef lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398736:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:0.0:1788791859.398740:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791859.398743:0:18896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324aef lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398749:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8ce00/0xcd6380150a324aef lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398759:0:18896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324ae1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398766:0:18896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324ae1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398772:0:18896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324ae1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398777:0:18896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ab981c8d600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791859.398787:0:18896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324ae1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398794:0:18896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324ae1 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398802:0:18896:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:0.0:1788791859.398805:0:18896:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788791859.398808:0:18896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324ae1 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.398815:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ab981c8d600/0xcd6380150a324ae1 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791859.399010:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+17:17497:x1875683606422656:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 34748us (35094us total) trans 12884901924 rc 0/0 00000100:00100000:0.0:1788791859.399019:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000020:00080000:0.0:1788791859.399023:0:18896:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788791859.399205:0:18928:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788791859.399210:0:18928:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788791859.399238:0:18928:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788791859.399245:0:18928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788791859.406199:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791859.406226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791859.406276:0:19582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606423040 00000100:00100000:0.0:1788791859.406286:0:19582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606423040 00000100:00100000:0.0:1788791859.406363:0:19582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:0.0:1788791859.406374:0:19582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+7:17496:x1875683606423040:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788791859.406391:0:19582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791859.406414:0:19582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d2c1758/0xcd6380150a324af6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675683 expref: -99 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788791859.406442:0:19582:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x6a9ecc32, atime: 0x6a9ecc30, ctime: 0x6a9ecc32, blocks: 0x1 00010000:00010000:0.0:1788791859.406461:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=635s v=(0 0) 00010000:00010000:0.0:1788791859.406466:0:19582:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791859.406488:0:19582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d2c1758/0xcd6380150a324af6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675683 expref: 8 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.406519:0:19582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d2c1758/0xcd6380150a324af6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675683 expref: 8 pid: 19582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791859.406532:0:19582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ab981c8d600, rc 0) 00000100:00100000:0.0:1788791859.406592:0:19582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+8:17496:x1875683606423040:12345-192.168.201.29@tcp:101:bash.0 Request processed in 220us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791859.406599:0:19582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:1.0:1788791859.406678:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606423296 00000100:00100000:1.0:1788791859.406683:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606423296 00000100:00100000:1.0:1788791859.406721:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1788791859.406728:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+17:17497:x1875683606423296:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788791859.407459:0:18898:0:(mdd_object.c:4131:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788791859.407569:0:18898:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:1.0:1788791859.407608:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324afd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.407623:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324afd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.407633:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324afd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.407641:0:18898:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324afd lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.407648:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324afd lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.407655:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324afd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.407677:0:18898:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788791859.407744:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+19:17497:x1875683606423296:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 1015us (1515us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1788791859.407754:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000020:00080000:1.0:1788791859.407765:0:18898:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788791859.407789:0:18883:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791859.407796:0:18883:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324afd lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.407804:0:18883:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92c000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791859.407808:0:18883:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324afd lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.407816:0:18883:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324afd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.407830:0:18883:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9aba8823cb00) 00010000:00010000:1.0:1788791859.407833:0:18883:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788791859.407838:0:18883:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324afd lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.407844:0:18883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324afd lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.407857:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791859.407859:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791859.407861:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791859.411259:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.412577:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606423552 00000100:00100000:1.0:1788791859.412590:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606423552 00000100:00100000:1.0:1788791859.412691:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:1.0:1788791859.412703:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+19:17496:x1875683606423552:12345-192.168.201.29@tcp:35:bash.0 00000001:00080000:1.0:1788791859.412976:0:18898:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:1.0:1788791859.413076:0:18898:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:1.0:1788791859.413219:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+22:17496:x1875683606423552:12345-192.168.201.29@tcp:35:bash.0 Request processed in 518us (1968us total) trans 12884901929 rc 0/0 00000100:00100000:1.0:1788791859.413235:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000020:00080000:1.0:1788791859.413240:0:18898:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788791859.491332:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788791859.491368:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630519296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791859.491445:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791859.491596:0:19585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630519296 00000100:00100000:1.0:1788791859.491619:0:19585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630519296 00000100:00100000:1.0:1788791859.491706:0:19585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788791859.491718:0:19585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630519296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788791859.491771:0:19585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791859.491834:0:19585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630519296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.491841:0:19585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788791859.491876:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630519552:0@lo:400:kworker.0 00000100:00100000:1.0:1788791859.491907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791859.491930:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788791859.491935:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3313:1875683630519424:0@lo:400:kworker.0 00000100:00100000:1.0:1788791859.491963:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791859.491992:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630519808:0@lo:400:kworker.0 00000100:00100000:1.0:1788791859.492016:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791859.492036:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788791859.492041:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630519680:0@lo:400:kworker.0 00000100:00100000:1.0:1788791859.492062:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791859.492089:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630519552 00000100:00100000:1.0:1788791859.492093:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630519552 00000100:00100000:1.0:1788791859.492118:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630519808 00000100:00100000:1.0:1788791859.492121:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630519808 00000100:00100000:1.0:1788791859.492161:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630519680 00000100:00100000:1.0:1788791859.492165:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630519680 00000100:00100000:1.0:1788791859.492182:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788791859.492205:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630519552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791859.492246:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630519552:12345-0@lo:400:kworker.0 Request processed in 42us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.492253:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788791859.492267:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788791859.492273:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630519808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791859.492319:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630519808:12345-0@lo:400:kworker.0 Request processed in 46us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.492326:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788791859.492339:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788791859.492344:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630519680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791859.492369:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630519680:12345-0@lo:400:kworker.0 Request processed in 25us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.492374:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788791859.492408:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630519680:0@lo:400:kworker.0 00000100:00100000:1.0:1788791859.492417:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630519808:0@lo:400:kworker.0 00000100:00100000:1.0:1788791859.492445:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630519552:0@lo:400:kworker.0 00000100:00080000:0.0:1788791859.492585:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788791859.492590:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788791859.493184:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630519424 00000100:00100000:2.0:1788791859.493189:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630519424 00000100:00100000:2.0:1788791859.493227:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788791859.493234:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab32f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3313:x1875683630519424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791859.493280:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab32f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bac980b1-b5e1-46bc-b749-0bf83764d3cb+19:3313:x1875683630519424:12345-0@lo:400:kworker.0 Request processed in 47us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791859.493298:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788791859.493337:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bac980b1-b5e1-46bc-b749-0bf83764d3cb:3313:1875683630519424:0@lo:400:kworker.0 00000100:00100000:3.0:1788791859.494235:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630519296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788791859.555375:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791859.596364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.596474:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606423808 00000100:00100000:1.0:1788791859.596485:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606423808 00000100:00100000:1.0:1788791859.596554:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:1.0:1788791859.596565:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+22:17507:x1875683606423808:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791859.596593:0:18895:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791859.596626:0:18895:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324b04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367568a expref: -99 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791859.596925:0:18895:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1788791859.597090:0:18895:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324b04 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367568a expref: 24 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.597105:0:18895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613700) 00010000:00010000:1.0:1788791859.597109:0:18895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788791859.597114:0:18895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c000/0xcd6380150a324b04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367568a expref: 24 pid: 18895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.597164:0:18895:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92c000, rc 0) 00000100:00100000:1.0:1788791859.597233:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+23:17507:x1875683606423808:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 669us (880us total) trans 12884901930 rc 301/301 00000100:00100000:1.0:1788791859.597241:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:3.0:1788791859.603651:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791859.603747:0:20097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606423936 00000100:00100000:1.0:1788791859.603758:0:20097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606423936 00000100:00100000:1.0:1788791859.603832:0:20097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:1.0:1788791859.603842:0:20097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+23:17507:x1875683606423936:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:1.0:1788791859.603918:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324b12 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.603935:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324b12 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.603945:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324b12 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.603959:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92da00/0xcd6380150a324b19 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.603979:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92da00/0xcd6380150a324b19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.603987:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92da00/0xcd6380150a324b19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604264:0:20097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d800/0xcd6380150a324b20 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604273:0:20097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d800/0xcd6380150a324b20 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604281:0:20097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d800/0xcd6380150a324b20 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788791859.604330:0:20097:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d800/0xcd6380150a324b20 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604342:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324b12 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604348:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324b12 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604355:0:20097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324b12 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604362:0:20097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92cc00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791859.604366:0:20097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324b12 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604373:0:20097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324b12 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604505:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9abaa0613500) 00010000:00010000:1.0:1788791859.604509:0:20097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791859.604513:0:20097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324b12 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604520:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92cc00/0xcd6380150a324b12 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604533:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92da00/0xcd6380150a324b19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604539:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92da00/0xcd6380150a324b19 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604545:0:20097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92da00/0xcd6380150a324b19 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604550:0:20097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92da00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791859.604553:0:20097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92da00/0xcd6380150a324b19 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604559:0:20097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92da00/0xcd6380150a324b19 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604565:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9aba9010ce00) 00010000:00010000:1.0:1788791859.604568:0:20097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791859.604570:0:20097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92da00/0xcd6380150a324b19 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604576:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92da00/0xcd6380150a324b19 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604599:0:20097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d800/0xcd6380150a324b20 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604605:0:20097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d800/0xcd6380150a324b20 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604611:0:20097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d800/0xcd6380150a324b20 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604616:0:20097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92d800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791859.604619:0:20097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d800/0xcd6380150a324b20 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604624:0:20097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d800/0xcd6380150a324b20 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604631:0:20097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:1.0:1788791859.604633:0:20097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791859.604635:0:20097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d800/0xcd6380150a324b20 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791859.604641:0:20097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d800/0xcd6380150a324b20 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791859.604745:0:20097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+23:17507:x1875683606423936:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 904us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791859.604753:0:20097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:3.0:1788791859.614529:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791859.625953:0:18899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606424192 00000100:00100000:0.0:1788791859.625968:0:18899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606424192 00000100:00100000:0.0:1788791859.626038:0:18899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:0.0:1788791859.626047:0:18899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+23:17507:x1875683606424192:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788791859.626519:0:18899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+24:17507:x1875683606424192:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 471us (11999us total) trans 12884901931 rc 0/0 00000100:00100000:0.0:1788791859.626527:0:18899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000001:00080000:2.0:1788791860.072402:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901892 is committed 00000001:00080000:2.0:1788791860.072425:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00010000:00010000:2.0:1788791860.579540:0:20559:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788791861.508830:0:21064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1788791861.605621:0:18883:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791862.051643:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630519936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791862.051738:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791862.051950:0:19585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630519936 00000100:00100000:1.0:1788791862.051958:0:19585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630519936 00000100:00100000:1.0:1788791862.052029:0:19585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788791862.052040:0:19585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630519936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791862.052075:0:19585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00080000:0.0:1788791862.052343:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791862.052636:0:19585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630519936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 597us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791862.052644:0:19585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788791862.052709:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:2.0:1788791862.052716:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9abab7987b80, transno 12884901891 00000004:00080000:2.0:1788791862.052950:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:2.0:1788791862.052999:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630519936:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788791862.628798:0:18884:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791862.831451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791862.831526:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791862.831615:0:19583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606424448 00000100:00100000:2.0:1788791862.831630:0:19583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606424448 00000100:00100000:2.0:1788791862.831846:0:19583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:2.0:1788791862.831857:0:19583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2354:x1875683606424448:12345-192.168.201.29@tcp:16:kworker.0 00000100:00100000:2.0:1788791862.831998:0:19583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2354:x1875683606424448:12345-192.168.201.29@tcp:16:kworker.0 Request processed in 143us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791862.832005:0:19583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1788791862.832223:0:19586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606424320 00000100:00100000:0.0:1788791862.832241:0:19586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606424320 00002000:00100000:0.0:1788791862.832269:0:19586:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x42:0x0] (0->8) req@ffff9aba85780700 x1875683606424320/t0(0) o4->35fd46c2-6db5-48a7-8c88-eca01b9f5ee2@192.168.201.29@tcp:573/0 lens 504/0 e 0 to 0 dl 1788791873 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788791862.832279:0:19586:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9aba85780700 with x1875683606424320 ext(0->8) 00002000:00010000:0.0:1788791862.832293:0:19586:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9aba85780700 00000100:00100000:0.0:1788791862.832319:0:19586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1788791862.832328:0:19586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+6:2354:x1875683606424320:12345-192.168.201.29@tcp:4:bash.0 00000100:00100000:0.0:1788791862.832858:0:19586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:35fd46c2-6db5-48a7-8c88-eca01b9f5ee2+8:2354:x1875683606424320:12345-192.168.201.29@tcp:4:bash.0 Request processed in 531us (1421us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788791862.832867:0:19586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00002000:00100000:0.0:1788791862.832875:0:19586:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x42:0x0] (0->8) req@ffff9aba85780700 x1875683606424320/t12884901894(0) o4->35fd46c2-6db5-48a7-8c88-eca01b9f5ee2@192.168.201.29@tcp:573/0 lens 504/448 e 0 to 0 dl 1788791873 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788791862.832884:0:19586:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9aba85780700 with x1875683606424320 ext(0->8) 00002000:00010000:0.0:1788791862.832887:0:19586:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9aba85780700 00000100:00080000:3.0:1788791862.836493:0:18891:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 10020 lines, 10020 kept, 0 dropped, 0 bad.